Apr 24 15:23:26 devstack cinder-volume[71617]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 15:23:26 devstack cinder-volume[71617]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 15:23:26 devstack cinder-volume[71617]: we strongly recommend against using it for new projects. Apr 24 15:23:26 devstack cinder-volume[71617]: If you are already using Eventlet, we recommend migrating to a different Apr 24 15:23:26 devstack cinder-volume[71617]: framework. For more detail see Apr 24 15:23:26 devstack cinder-volume[71617]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 15:23:26 devstack cinder-volume[71617]: import eventlet # noqa Apr 24 15:23:27 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:23:27 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:23:27 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:23:28 devstack cinder-volume[71617]: INFO dbcounter [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Registered counter for database cinder Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG oslo_db.sqlalchemy.engines [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG dbcounter [-] [71617] Writer thread running {{(pid=71617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:23:28 devstack cinder-volume[71617]: INFO cinder.rpc [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 15:23:28 devstack cinder-volume[71617]: INFO cinder.rpc [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG oslo_db.sqlalchemy.engines [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:23:28 devstack cinder-volume[71617]: INFO cinder.volume.manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Determined volume DB was empty at startup. Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG cinder.volume.manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71617) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 15:23:28 devstack cinder-volume[71617]: INFO cinder.volume.manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 15:23:28 devstack cinder-volume[71617]: WARNING stevedore.named [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 15:23:28 devstack cinder-volume[71617]: WARNING castellan.key_manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:23:28 devstack cinder-volume[71617]: WARNING cinder.keymgr.conf_key_mgr [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG cinder.volume.drivers.lvm [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71617) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 15:23:28 devstack cinder-volume[71617]: DEBUG oslo_concurrency.processutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_concurrency.processutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] CMD "cinder-rtstool verify" returned: 0 in 0.258s {{(pid=71617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_db.sqlalchemy.engines [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:23:29 devstack cinder-volume[71617]: INFO cinder.rpc [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 15:23:29 devstack cinder-volume[71617]: INFO cinder.rpc [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 15:23:29 devstack cinder-volume[71617]: WARNING stevedore.named [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 15:23:29 devstack cinder-volume[71617]: WARNING castellan.key_manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:23:29 devstack cinder-volume[71617]: INFO cinder.volume.manager [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_db.sqlalchemy.engines [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:23:29 devstack cinder-volume[71617]: INFO oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Starting 1 workers Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Started child 71729 {{(pid=71617) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Full set of CONF: {{(pid=71617) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] ******************************************************************************** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Configuration options gathered from: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] ================================================================================ {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] allow_availability_zone_fallback = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] allow_compression_on_image_upload = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] allowed_direct_url_schemes = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] api_rate_limit = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] auth_strategy = keystone {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] az_cache_duration = 3600 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_availability_zone = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_host = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_stats_polling_interval = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backup_api_class = cinder.backup.api.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backup_name_template = backup-%s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backup_use_same_host = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backup_use_temp_snapshot = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] chap_password = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] chap_username = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_internal_tenant_project_id = 02caebc4d6e846febef2615413e3822f {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71729]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_internal_tenant_user_id = 87269b24028f41bd82be3b41c60451f3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cloned_volume_same_az = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cluster = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] compression_format = gzip {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] compute_api_class = cinder.compute.nova.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] config_dir = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] config_source = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] control_exchange = openstack {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] debug = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] default_availability_zone = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] default_group_type = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] default_volume_type = lvmdriver-1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] disk_geometry = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_client_cert = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_client_cert_key = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_data_namespace = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_ssl_cert_path = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_ssl_cert_verify = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] driver_use_ssl = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] enable_force_upload = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] enable_new_services = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] enable_unsupported_driver = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] enabled_backends = ['lvmdriver-1'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] enforce_multipath_for_image_xfer = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] filter_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_api_insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_api_ssl_compression = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_ca_certificates_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_catalog_info = image:glance:publicURL {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_num_retries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance_request_timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] goodness_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] graceful_shutdown_timeout = 5 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] group_api_class = cinder.group.api.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] host = devstack {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_compress_on_upload = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_conversion_address_space_limit = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_conversion_cpu_limit = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_conversion_disable = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_upload_use_cinder_backend = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_upload_use_internal_tenant = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_volume_cache_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_volume_cache_max_count = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] image_volume_cache_max_size_gb = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] init_host_max_objects_retrieval = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] instance_format = [instance: %(uuid)s] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iscsi_target_flags = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iscsi_write_cache = on {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iser_helper = tgtadm {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iser_ip_address = 192.168.122.229 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iser_port = 3260 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_color = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_config_append = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_dir = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_options = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_rotate_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_rotate_interval_type = days {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] log_rotation_type = none {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71729]: INFO cinder.volume.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] max_age = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] max_logfile_count = 30 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] max_logfile_size_mb = 200 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] max_over_subscription_ratio = 20.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] message_reap_interval = 86400 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] message_ttl = 2592000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] migration_create_volume_timeout_secs = 300 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] monkey_patch = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] monkey_patch_modules = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] my_ip = 192.168.122.229 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] no_snapshot_gb_quota = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] num_iser_scan_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] num_shell_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] num_volume_device_scan_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] nvmeof_conn_info_version = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] nvmet_ns_id = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] nvmet_port_id = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_max_limit = 1000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_ext_list = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_listen = 0.0.0.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_listen_port = 8776 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_use_ssl = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] osapi_volume_workers = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] per_volume_size_limit = -1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] periodic_fuzzy_delay = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] periodic_interval = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] project_id_regex = [0-9a-f\-]+ {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] public_endpoint = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] publish_errors = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_backup_gigabytes = 1000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_backups = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_gigabytes = 1000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_groups = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_snapshots = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] quota_volumes = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] rate_limit_burst = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] rate_limit_except_level = CRITICAL {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] rate_limit_interval = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] reinit_driver_count = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] replication_device = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] report_discard_supported = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] report_interval = 120 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] reservation_clean_interval = 86400 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] reservation_expire = 86400 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] reserved_image_namespaces = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] reserved_percentage = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] rpc_response_timeout = 120 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] run_external_periodic_tasks = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] scst_target_driver = iscsi {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] scst_target_iqn_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_down_time = 720 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] shell_completion = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] snapshot_name_template = snapshot-%s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] snapshot_same_host = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] split_loggers = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] state_path = /opt/stack/data/cinder {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] storage_availability_zone = nova {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] storage_protocol = iSCSI {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] syslog_log_facility = LOG_USER {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_helper = lioadm {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_ip_address = 192.168.122.229 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_port = 3260 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_protocol = iscsi {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] target_secondary_ip_addresses = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] trace_flags = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] transfer_api_class = cinder.transfer.api.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] transport_url = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] until_refresh = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_chap_auth = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_default_quota_class = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_journal = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_json = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_multipath_for_image_xfer = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_stderr = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] use_syslog = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] verify_glance_signatures = enabled {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_api_class = cinder.volume.api.API {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_backend_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_clear = zero {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_clear_ionice = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_clear_size = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_copy_bps_limit = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_dd_blocksize = 1M {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_name_template = volume-%s {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_service_inithost_offload = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volume_usage_audit_period = month {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] zoning_mode = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_concurrency.disable_process_locking = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.admin_password = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.admin_token = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.admin_user = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_admin_prefix = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_port = 35357 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_protocol = https {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_section = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_type = password {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_uri = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.auth_version = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.cache = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.identity_uri = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.include_service_catalog = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.interface = public {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_password = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcache_username = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.region_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.service_token_roles_required = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.service_type = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.backend = dogpile.cache.null {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.backend_argument = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.backend_expiration_time = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.config_prefix = cache.oslo {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.debug_cache_backend = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.enable_retry_client = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.enable_socket_keepalive = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.enforce_fips_mode = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.expiration_time = 600 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.hashclient_retry_attempts = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_dead_retry = 300 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_pool_maxsize = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_sasl_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.password = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.proxies = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.redis_db = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.redis_server = localhost:6379 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.retry_attempts = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.retry_delay = 0.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.socket_keepalive_count = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.socket_keepalive_idle = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.socket_keepalive_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.socket_timeout = 1.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.tls_allowed_ciphers = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.tls_cafile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.tls_certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.tls_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.tls_keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cache.username = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] coordination.backend_url = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.asyncio_connection = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.asyncio_slave_connection = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.backend = sqlalchemy {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.connection = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.connection_debug = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.connection_parameters = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.connection_recycle_time = 3600 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.connection_trace = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.db_inc_retry_interval = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.db_max_retries = 20 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.db_max_retry_interval = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.db_retry_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.max_overflow = 50 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.max_pool_size = 5 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.max_retries = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.mysql_wsrep_sync_wait = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.pool_timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.retry_interval = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.slave_connection = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.sqlite_synchronous = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.synchronous_reader = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] database.use_db_reconnect = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.connection_string = messaging:// {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.es_doc_type = notification {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.es_scroll_size = 10000 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.es_scroll_time = 2m {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.filter_error_trace = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.hmac_keys = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.sentinel_service_name = mymaster {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.socket_timeout = 0.1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.trace_requests = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler.trace_sqlalchemy = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler_jaeger.process_tags = {} {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler_jaeger.service_name_prefix = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] profiler_otlp.service_name_prefix = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.enforce_new_defaults = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: WARNING oslo_config.cfg [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.enforce_scope = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.policy_default_rule = default {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.policy_file = policy.yaml {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_policy.remote_timeout = 60.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.group = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.helper_command = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] privsep_osbrick.user = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.group = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.helper_command = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] cinder_sys_admin.user = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.auth_section = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.auth_type = password {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.cafile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.collect_timing = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.send_service_user_token = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.split_loggers = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] service_user.timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.auth_section = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.auth_type = password {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.collect_timing = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.region_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.split_loggers = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] glance.timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.backend_availability_zone = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.chap_password = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.chap_username = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.disk_geometry = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_client_cert = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_client_cert_key = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_data_namespace = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.driver_use_ssl = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.extra_capabilities = {} {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.filter_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.goodness_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iscsi_target_flags = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iscsi_write_cache = on {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iser_helper = tgtadm {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iser_port = 3260 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.lvm_mirrors = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.lvm_share_target = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.lvm_type = auto {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.num_shell_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack sudo[71733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.replication_device = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.report_discard_supported = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.reserved_percentage = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack sudo[71733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_helper = tgtadm {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_port = 3260 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_protocol = iscsi {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.trace_flags = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.unique_fqdn_network = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.use_chap_auth = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_backend_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_clear = zero {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_clear_ionice = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_clear_size = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volume_group = cinder-volumes {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_reports.file_event_handler = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_reports.log_dir = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.backend_availability_zone = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.backend_host = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.chap_password = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.chap_username = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.chiscsi_conf = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.disk_geometry = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_client_cert = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_data_namespace = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.driver_use_ssl = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.extra_capabilities = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.filter_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.goodness_function = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iser_helper = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iser_ip_address = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iser_port = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.iser_target_prefix = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.lvm_conf_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.lvm_mirrors = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.lvm_share_target = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.lvm_type = auto {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.num_shell_tries = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.nvmet_port_id = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.replication_device = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.report_discard_supported = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.reserved_percentage = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.scst_target_driver = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.storage_protocol = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_helper = lioadm {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_ip_address = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_port = 3260 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_protocol = iscsi {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.trace_flags = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.use_chap_auth = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_clear = zero {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_clear_size = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] lvmdriver-1.volumes_dir = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.ssl_version = {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_notifications.driver = [] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_notifications.retry = -1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] key_manager.fixed_key = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.barbican_api_version = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.barbican_endpoint = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.barbican_endpoint_type = public {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.barbican_region_name = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.cafile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.collect_timing = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.number_of_retries = 60 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.retry_delay = 1 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.send_service_user_token = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.split_loggers = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.verify_ssl = True {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican.verify_ssl_path = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.auth_section = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.auth_type = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.cafile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.certfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.collect_timing = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.insecure = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.keyfile = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.split_loggers = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] barbican_service_user.timeout = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.approle_role_id = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.approle_secret_id = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.kv_mountpoint = secret {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.kv_path = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.kv_version = 2 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.namespace = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.root_token_id = **** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.ssl_ca_crt_file = None {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.timeout = 60.0 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.use_ssl = False {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:23:29 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] ******************************************************************************** {{(pid=71617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 15:23:29 devstack sudo[71733]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:29 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:29 devstack sudo[71737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:29 devstack sudo[71737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:30 devstack sudo[71737]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.510s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:23:30 devstack cinder-volume[71729]: INFO cinder.brick.local_dev.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:30 devstack sudo[71907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:30 devstack sudo[71907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:30 devstack sudo[71907]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG cinder.brick.local_dev.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71729) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 15:23:30 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:30 devstack sudo[72085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:30 devstack sudo[72085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:32 devstack sudo[72085]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:32 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.578s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:32 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:32 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:32 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:32 devstack sudo[72424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:32 devstack sudo[72424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:33 devstack sudo[72424]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:33 devstack sudo[72431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 15:23:33 devstack sudo[72431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:33 devstack sudo[72431]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.461s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:33 devstack sudo[72434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:33 devstack sudo[72434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:33 devstack sudo[72434]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:33 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:33 devstack sudo[72439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:33 devstack sudo[72439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:34 devstack sudo[72439]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:34 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:34 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:34 devstack sudo[72442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:34 devstack sudo[72442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:35 devstack sudo[72442]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:35 devstack sudo[72450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:35 devstack sudo[72450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:35 devstack sudo[72450]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.425s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:35 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:35 devstack sudo[72454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:35 devstack sudo[72454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:36 devstack sudo[72454]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:36 devstack cinder-volume[71729]: INFO cinder.volume.drivers.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:36 devstack sudo[72464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:36 devstack sudo[72464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:36 devstack sudo[72464]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.555s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:23:36 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:36 devstack sudo[72579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:36 devstack sudo[72579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:37 devstack sudo[72579]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:37 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:37 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:37 devstack sudo[72582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:37 devstack sudo[72582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:37 devstack sudo[72582]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:37 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:37 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:37 devstack sudo[72724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:37 devstack sudo[72724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:38 devstack sudo[72724]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:38 devstack sudo[72727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:38 devstack sudo[72727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:38 devstack sudo[72727]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:38 devstack cinder-volume[71729]: INFO cinder.volume.driver [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG cinder.volume.driver [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71729) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG oslo_db.sqlalchemy.engines [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71729) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG dbcounter [-] [71729] Writer thread running {{(pid=71729) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG cinder.db.sqlalchemy.api [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Building query based on filter {{(pid=71729) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG cinder.image.image_utils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71729) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 15:23:38 devstack cinder-volume[71729]: INFO cinder.keymgr.migration [None req-ad9bd9ec-87ef-4a4d-8df4-eb54d34176e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:23:38 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:38 devstack sudo[72731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:38 devstack sudo[72731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:39 devstack sudo[72731]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:39 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:39 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:39 devstack cinder-volume[71617]: DEBUG dbcounter [-] [71617] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:23:39 devstack sudo[72738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:39 devstack sudo[72738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:39 devstack sudo[72738]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:39 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:39 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:39 devstack sudo[72742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:39 devstack sudo[72742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:40 devstack sudo[72742]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:40 devstack sudo[72747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:40 devstack sudo[72747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:40 devstack sudo[72747]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG cinder.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Notifying Schedulers of capabilities ... {{(pid=71729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:23:40 devstack cinder-volume[71729]: INFO cinder.volume.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Driver initialization completed successfully. Apr 24 15:23:40 devstack cinder-volume[71729]: INFO cinder.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Initiating service 2 cleanup Apr 24 15:23:40 devstack cinder-volume[71729]: INFO cinder.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Service 2 cleanup completed. Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG cinder.service [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Creating RPC server for service cinder-volume {{(pid=71729) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG cinder.service [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71729) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 15:23:40 devstack cinder-volume[71729]: INFO cinder.volume.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:23:40 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:40 devstack sudo[72753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:23:40 devstack sudo[72753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:41 devstack sudo[72753]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:41 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:41 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:41 devstack sudo[72757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:41 devstack sudo[72757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:41 devstack sudo[72757]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:41 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:41 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:41 devstack sudo[72760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:23:41 devstack sudo[72760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:42 devstack sudo[72760]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:42 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:42 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:23:42 devstack sudo[72814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:23:42 devstack sudo[72814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:23:42 devstack sudo[72814]: pam_unix(sudo:session): session closed for user root Apr 24 15:23:42 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:23:42 devstack cinder-volume[71729]: INFO cinder.volume.manager [None req-248836f2-a661-43b2-bc40-abda6c615422 None None] Driver post RPC initialization completed successfully. Apr 24 15:23:52 devstack cinder-volume[71729]: DEBUG dbcounter [-] [71729] Writing DB stats cinder:SELECT=4 {{(pid=71729) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:23:52 devstack cinder-volume[71729]: DEBUG dbcounter [-] [71729] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71729) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:24:45 devstack cinder-volume[71729]: DEBUG oslo_service.periodic_task [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71729) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:24:45 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:24:45 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:24:45 devstack sudo[77542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:24:45 devstack sudo[77542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:24:46 devstack sudo[77542]: pam_unix(sudo:session): session closed for user root Apr 24 15:24:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:24:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:24:46 devstack sudo[77545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:24:46 devstack sudo[77545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:24:46 devstack sudo[77545]: pam_unix(sudo:session): session closed for user root Apr 24 15:24:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:24:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:24:46 devstack sudo[77548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:24:46 devstack sudo[77548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:24:47 devstack sudo[77548]: pam_unix(sudo:session): session closed for user root Apr 24 15:24:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:24:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:24:47 devstack sudo[77551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:24:47 devstack sudo[77551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:24:47 devstack sudo[77551]: pam_unix(sudo:session): session closed for user root Apr 24 15:24:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:24:47 devstack cinder-volume[71729]: DEBUG cinder.manager [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Notifying Schedulers of capabilities ... {{(pid=71729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:25:45 devstack cinder-volume[71729]: DEBUG oslo_service.periodic_task [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71729) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:25:45 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:25:45 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:25:45 devstack sudo[78721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:25:45 devstack sudo[78721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:25:46 devstack sudo[78721]: pam_unix(sudo:session): session closed for user root Apr 24 15:25:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:25:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:25:46 devstack sudo[78771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:25:46 devstack sudo[78771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:25:46 devstack sudo[78771]: pam_unix(sudo:session): session closed for user root Apr 24 15:25:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:25:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:25:46 devstack sudo[78802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:25:46 devstack sudo[78802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:25:47 devstack sudo[78802]: pam_unix(sudo:session): session closed for user root Apr 24 15:25:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:25:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:25:47 devstack sudo[78816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:25:47 devstack sudo[78816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:25:47 devstack sudo[78816]: pam_unix(sudo:session): session closed for user root Apr 24 15:25:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:25:47 devstack cinder-volume[71729]: DEBUG cinder.manager [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Notifying Schedulers of capabilities ... {{(pid=71729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:25:52 devstack cinder-volume[71729]: DEBUG dbcounter [-] [71729] Writing DB stats cinder:SELECT=1 {{(pid=71729) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:25:52 devstack cinder-volume[71729]: DEBUG dbcounter [-] [71729] Writing DB stats cinder:UPDATE=1 {{(pid=71729) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:26:45 devstack cinder-volume[71729]: DEBUG oslo_service.periodic_task [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71729) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:26:45 devstack cinder-volume[71729]: DEBUG cinder.volume.drivers.lvm [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Updating volume stats {{(pid=71729) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 15:26:45 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:26:45 devstack sudo[80367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 15:26:45 devstack sudo[80367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:26:46 devstack sudo[80367]: pam_unix(sudo:session): session closed for user root Apr 24 15:26:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:26:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:26:46 devstack sudo[80393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:26:46 devstack sudo[80393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:26:46 devstack sudo[80393]: pam_unix(sudo:session): session closed for user root Apr 24 15:26:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:26:46 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:26:46 devstack sudo[80399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 15:26:46 devstack sudo[80399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:26:47 devstack sudo[80399]: pam_unix(sudo:session): session closed for user root Apr 24 15:26:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:26:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:26:47 devstack sudo[80403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 15:26:47 devstack sudo[80403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:26:47 devstack sudo[80403]: pam_unix(sudo:session): session closed for user root Apr 24 15:26:47 devstack cinder-volume[71729]: DEBUG oslo_concurrency.processutils [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=71729) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:26:47 devstack cinder-volume[71729]: DEBUG cinder.manager [None req-4c07f544-149b-4555-bbb3-bd1011361620 None None] Notifying Schedulers of capabilities ... {{(pid=71729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:27:04 devstack cinder-volume[71617]: INFO oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Caught SIGTERM, stopping children Apr 24 15:27:04 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Acquiring lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:04 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Acquired lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:04 devstack cinder-volume[71617]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Releasing lock "singleton_lock" {{(pid=71617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:04 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Stop services. {{(pid=71617) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 15:27:04 devstack cinder-volume[71617]: DEBUG oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Killing children. {{(pid=71617) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 15:27:04 devstack cinder-volume[71617]: INFO oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Waiting on 1 children to exit Apr 24 15:27:05 devstack cinder-volume[71729]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Acquiring lock "singleton_lock" {{(pid=71729) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:05 devstack cinder-volume[71729]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Acquired lock "singleton_lock" {{(pid=71729) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:05 devstack cinder-volume[71729]: DEBUG oslo_concurrency.lockutils [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Releasing lock "singleton_lock" {{(pid=71729) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:05 devstack cinder-volume[71729]: WARNING amqp [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 15:27:05 devstack cinder-volume[71729]: WARNING amqp [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 15:27:05 devstack cinder-volume[71617]: INFO oslo_service.backend._eventlet.service [None req-e82ebd1f-eda5-40fb-a84e-e8acc263b9eb None None] Child 71729 exited with status 0 Apr 24 15:27:06 devstack cinder-volume[80928]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 15:27:06 devstack cinder-volume[80928]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 15:27:06 devstack cinder-volume[80928]: we strongly recommend against using it for new projects. Apr 24 15:27:06 devstack cinder-volume[80928]: If you are already using Eventlet, we recommend migrating to a different Apr 24 15:27:06 devstack cinder-volume[80928]: framework. For more detail see Apr 24 15:27:06 devstack cinder-volume[80928]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 15:27:06 devstack cinder-volume[80928]: import eventlet # noqa Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:08 devstack cinder-volume[80928]: INFO dbcounter [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Registered counter for database cinder Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_db.sqlalchemy.engines [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG dbcounter [-] [80928] Writer thread running {{(pid=80928) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:27:08 devstack cinder-volume[80928]: INFO cinder.rpc [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 15:27:08 devstack cinder-volume[80928]: INFO cinder.rpc [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_db.sqlalchemy.engines [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:08 devstack cinder-volume[80928]: INFO cinder.volume.manager [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Determined volume DB was empty at startup. Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG cinder.volume.manager [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80928) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 15:27:08 devstack cinder-volume[80928]: INFO cinder.volume.manager [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 15:27:08 devstack cinder-volume[80928]: WARNING stevedore.named [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 15:27:08 devstack cinder-volume[80928]: WARNING castellan.key_manager [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:27:08 devstack cinder-volume[80928]: WARNING cinder.keymgr.conf_key_mgr [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:27:08 devstack cinder-volume[80928]: INFO cinder.volume.manager [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 15:27:08 devstack cinder-volume[80928]: DEBUG oslo_db.sqlalchemy.engines [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:09 devstack cinder-volume[80928]: INFO oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Starting 1 workers Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Started child 81043 {{(pid=80928) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Full set of CONF: {{(pid=80928) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] ******************************************************************************** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Configuration options gathered from: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] ================================================================================ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] allow_availability_zone_fallback = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] allow_compression_on_image_upload = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] allowed_direct_url_schemes = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] api_rate_limit = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] auth_strategy = keystone {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_availability_zone = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_host = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_stats_polling_interval = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backup_api_class = cinder.backup.api.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backup_name_template = backup-%s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backup_use_same_host = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backup_use_temp_snapshot = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] chap_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] chap_username = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_internal_tenant_project_id = 02caebc4d6e846febef2615413e3822f {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_internal_tenant_user_id = 87269b24028f41bd82be3b41c60451f3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cluster = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] compression_format = gzip {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] compute_api_class = cinder.compute.nova.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] config_dir = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] config_source = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] control_exchange = openstack {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] debug = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] default_availability_zone = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] default_group_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] default_volume_type = QuobyteHD {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] disk_geometry = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_client_cert = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_client_cert_key = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_data_namespace = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_ssl_cert_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_ssl_cert_verify = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] driver_use_ssl = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] enable_new_services = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] enable_unsupported_driver = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] enabled_backends = ['QuobyteHD'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] enforce_multipath_for_image_xfer = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] filter_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_api_insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_api_ssl_compression = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_ca_certificates_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_catalog_info = image:glance:publicURL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_num_retries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance_request_timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] goodness_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] graceful_shutdown_timeout = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] group_api_class = cinder.group.api.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] host = devstack {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_compress_on_upload = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_conversion_address_space_limit = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_conversion_cpu_limit = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_conversion_disable = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_upload_use_cinder_backend = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_upload_use_internal_tenant = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_volume_cache_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_volume_cache_max_count = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] image_volume_cache_max_size_gb = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] init_host_max_objects_retrieval = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] instance_format = [instance: %(uuid)s] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iscsi_target_flags = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iscsi_write_cache = on {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iser_helper = tgtadm {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iser_ip_address = 192.168.122.229 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iser_port = 3260 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[81043]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_color = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_config_append = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_dir = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_options = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_rotate_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_rotate_interval_type = days {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] log_rotation_type = none {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] max_age = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] max_logfile_count = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] max_logfile_size_mb = 200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] max_over_subscription_ratio = 20.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] message_reap_interval = 86400 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] message_ttl = 2592000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] migration_create_volume_timeout_secs = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] monkey_patch = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] monkey_patch_modules = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] my_ip = 192.168.122.229 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] no_snapshot_gb_quota = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] num_iser_scan_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] num_shell_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] num_volume_device_scan_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] nvmeof_conn_info_version = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] nvmet_ns_id = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] nvmet_port_id = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_max_limit = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_ext_list = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_listen = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_listen_port = 8776 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_use_ssl = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] osapi_volume_workers = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] per_volume_size_limit = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] periodic_fuzzy_delay = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] periodic_interval = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] project_id_regex = [0-9a-f\-]+ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] public_endpoint = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] publish_errors = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_backup_gigabytes = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_backups = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_gigabytes = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[81043]: INFO cinder.volume.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.remotefs [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81043) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_groups = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_snapshots = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] quota_volumes = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] rate_limit_burst = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] rate_limit_except_level = CRITICAL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] rate_limit_interval = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] reinit_driver_count = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] replication_device = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] report_discard_supported = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] report_interval = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] reservation_clean_interval = 86400 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] reservation_expire = 86400 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] reserved_image_namespaces = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] reserved_percentage = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] rpc_response_timeout = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] run_external_periodic_tasks = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] scst_target_driver = iscsi {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] scst_target_iqn_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_down_time = 720 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] shell_completion = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] snapshot_name_template = snapshot-%s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] state_path = /opt/stack/data/cinder {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] storage_availability_zone = nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] storage_protocol = iSCSI {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] syslog_log_facility = LOG_USER {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_helper = lioadm {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_ip_address = 192.168.122.229 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_port = 3260 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_protocol = iscsi {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] target_secondary_ip_addresses = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] trace_flags = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] transfer_api_class = cinder.transfer.api.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] transport_url = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] until_refresh = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_chap_auth = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_default_quota_class = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_journal = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_json = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_multipath_for_image_xfer = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_stderr = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] use_syslog = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] verify_glance_signatures = enabled {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_api_class = cinder.volume.api.API {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_backend_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_clear = zero {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_clear_ionice = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_clear_size = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_copy_bps_limit = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_dd_blocksize = 1M {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_name_template = volume-%s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_service_inithost_offload = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volume_usage_audit_period = month {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] zoning_mode = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_concurrency.disable_process_locking = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.admin_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.admin_token = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.admin_user = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_admin_prefix = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_port = 35357 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_protocol = https {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_type = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81043) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 15:27:09 devstack cinder-volume[81043]: WARNING cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 15:27:09 devstack cinder-volume[81043]: WARNING cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_uri = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.auth_version = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Running cmd (subprocess): mount.quobyte {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.cache = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.identity_uri = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.include_service_catalog = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.interface = public {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_password = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcache_username = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.region_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.service_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.backend = dogpile.cache.null {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.backend_argument = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.backend_expiration_time = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.config_prefix = cache.oslo {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.debug_cache_backend = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.enable_retry_client = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.enable_socket_keepalive = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.enforce_fips_mode = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.expiration_time = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.hashclient_retry_attempts = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_dead_retry = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_pool_maxsize = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_sasl_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.proxies = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.redis_db = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.redis_server = localhost:6379 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.retry_attempts = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.retry_delay = 0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.socket_keepalive_count = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.socket_keepalive_idle = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.socket_keepalive_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.socket_timeout = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.tls_allowed_ciphers = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.tls_cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.tls_certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.tls_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.tls_keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cache.username = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] coordination.backend_url = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.asyncio_connection = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.asyncio_slave_connection = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.backend = sqlalchemy {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.connection = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.connection_debug = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.connection_parameters = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.connection_recycle_time = 3600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.connection_trace = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.db_inc_retry_interval = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.db_max_retries = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.db_max_retry_interval = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.db_retry_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.max_overflow = 50 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.max_pool_size = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.max_retries = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.mysql_wsrep_sync_wait = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.pool_timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.retry_interval = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.slave_connection = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.sqlite_synchronous = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.synchronous_reader = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] database.use_db_reconnect = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.connection_string = messaging:// {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.es_doc_type = notification {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.es_scroll_size = 10000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.es_scroll_time = 2m {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.filter_error_trace = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.hmac_keys = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.sentinel_service_name = mymaster {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.socket_timeout = 0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.trace_requests = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler.trace_sqlalchemy = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler_jaeger.process_tags = {} {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler_jaeger.service_name_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] profiler_otlp.service_name_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.enforce_new_defaults = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: WARNING oslo_config.cfg [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.enforce_scope = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.policy_default_rule = default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.policy_file = policy.yaml {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_policy.remote_timeout = 60.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack quobyte-client[81046]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.group = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.helper_command = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack quobyte-client[81046]: Invalid parameters found, error: missing mount point. Apr 24 15:27:09 devstack quobyte-client[81046]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 15:27:09 devstack quobyte-client[81046]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] privsep_osbrick.user = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.group = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.helper_command = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] cinder_sys_admin.user = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.auth_type = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.send_service_user_token = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] service_user.timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.auth_type = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:09 devstack cinder-volume[81043]: INFO cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e ... Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 -c /etc/quobyte/client-cinder.cfg {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.region_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] glance.timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.backend_availability_zone = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.chap_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.chap_username = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.disk_geometry = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_client_cert = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_client_cert_key = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_data_namespace = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.driver_use_ssl = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.extra_capabilities = {} {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.filter_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.goodness_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iscsi_target_flags = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iscsi_write_cache = on {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iser_helper = tgtadm {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iser_port = 3260 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_host = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_login = admin {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_mount_options = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_private_key = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_share_path = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_ssh_port = 22 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.num_shell_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.quobyte_volume_url = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.replication_device = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.report_discard_supported = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.reserved_percentage = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_helper = tgtadm {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_port = 3260 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_protocol = iscsi {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.trace_flags = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.unique_fqdn_network = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.use_chap_auth = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_backend_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_clear = zero {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_clear_ionice = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_clear_size = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_reports.file_event_handler = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_reports.log_dir = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.backend_availability_zone = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.backend_host = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.chap_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.chap_username = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.chiscsi_conf = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.disk_geometry = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_client_cert = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_data_namespace = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.driver_use_ssl = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.extra_capabilities = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.filter_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.goodness_function = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iscsi_target_flags = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iscsi_write_cache = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iser_helper = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iser_ip_address = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iser_port = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.iser_target_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_host = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_login = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_mount_options = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_password = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_private_key = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_share_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_ssh_port = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.num_shell_tries = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nvmet_ns_id = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.nvmet_port_id = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.replication_device = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.report_discard_supported = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.reserved_percentage = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.scst_target_driver = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.storage_protocol = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_helper = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_ip_address = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_port = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_protocol = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.trace_flags = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.unique_fqdn_network = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.use_chap_auth = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_clear = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_clear_ionice = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_clear_size = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack sudo[81047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 -c /etc/quobyte/client-cinder.cfg Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] QuobyteHD.volumes_dir = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack sudo[81047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.ssl_version = {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_notifications.driver = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_notifications.retry = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] key_manager.fixed_key = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.barbican_api_version = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.barbican_endpoint = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.barbican_endpoint_type = public {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.barbican_region_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.number_of_retries = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.retry_delay = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.send_service_user_token = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.verify_ssl = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican.verify_ssl_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.auth_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] barbican_service_user.timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.approle_role_id = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.approle_secret_id = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.kv_mountpoint = secret {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.kv_path = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.kv_version = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.namespace = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.root_token_id = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.ssl_ca_crt_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.timeout = 60.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.use_ssl = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:09 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] ******************************************************************************** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 15:27:09 devstack sudo[81047]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.564s {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:09 devstack cinder-volume[81043]: INFO cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e succeeded Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.574s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:09 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:09 devstack sudo[81116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:09 devstack sudo[81116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:10 devstack sudo[81116]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.387s {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.volume.driver [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Driver hasn't implemented _init_vendor_properties() Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.volume.driver [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309799194336, 'free_capacity_gb': 1775.7309799194336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81043) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_db.sqlalchemy.engines [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81043) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG dbcounter [-] [81043] Writer thread running {{(pid=81043) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.db.sqlalchemy.api [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Building query based on filter {{(pid=81043) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.image.image_utils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81043) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.keymgr.migration [None req-f3c3295c-8b66-4df3-92ba-f8e6f7d8d377 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:10 devstack sudo[81119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:10 devstack sudo[81119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:10 devstack sudo[81119]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.380s {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Notifying Schedulers of capabilities ... {{(pid=81043) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.volume.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Driver initialization completed successfully. Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Initiating service 3 cleanup Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Service 3 cleanup completed. Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.service [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Creating RPC server for service cinder-volume {{(pid=81043) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.service [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81043) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 15:27:10 devstack cinder-volume[81043]: INFO cinder.volume.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG cinder.volume.drivers.quobyte [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81043) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:10 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:10 devstack sudo[81125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:10 devstack sudo[81125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:11 devstack sudo[81125]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:11 devstack cinder-volume[81043]: DEBUG oslo_concurrency.processutils [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.488s {{(pid=81043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:11 devstack cinder-volume[81043]: INFO cinder.volume.manager [None req-516350b2-f410-4b54-914f-c344cea85f0b None None] Driver post RPC initialization completed successfully. Apr 24 15:27:13 devstack cinder-volume[80928]: INFO oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Caught SIGTERM, stopping children Apr 24 15:27:13 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Acquiring lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:13 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Acquired lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:13 devstack cinder-volume[80928]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Releasing lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:13 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Stop services. {{(pid=80928) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 15:27:13 devstack cinder-volume[80928]: DEBUG oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Killing children. {{(pid=80928) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 15:27:13 devstack cinder-volume[80928]: INFO oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Waiting on 1 children to exit Apr 24 15:27:14 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Acquiring lock "singleton_lock" {{(pid=81043) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:14 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Acquired lock "singleton_lock" {{(pid=81043) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:14 devstack cinder-volume[81043]: DEBUG oslo_concurrency.lockutils [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Releasing lock "singleton_lock" {{(pid=81043) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:14 devstack cinder-volume[81043]: WARNING amqp [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 15:27:14 devstack cinder-volume[81043]: WARNING amqp [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 15:27:14 devstack cinder-volume[80928]: INFO oslo_service.backend._eventlet.service [None req-deb52021-fc83-4719-b8c4-32cd59cd1310 None None] Child 81043 exited with status 0 Apr 24 15:27:15 devstack cinder-volume[81699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 15:27:15 devstack cinder-volume[81699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 15:27:15 devstack cinder-volume[81699]: we strongly recommend against using it for new projects. Apr 24 15:27:15 devstack cinder-volume[81699]: If you are already using Eventlet, we recommend migrating to a different Apr 24 15:27:15 devstack cinder-volume[81699]: framework. For more detail see Apr 24 15:27:15 devstack cinder-volume[81699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 15:27:15 devstack cinder-volume[81699]: import eventlet # noqa Apr 24 15:27:17 devstack cinder-volume[81699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 15:27:17 devstack cinder-volume[81699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 15:27:17 devstack cinder-volume[81699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 15:27:18 devstack cinder-volume[81699]: INFO dbcounter [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Registered counter for database cinder Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_db.sqlalchemy.engines [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG dbcounter [-] [81699] Writer thread running {{(pid=81699) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:27:18 devstack cinder-volume[81699]: INFO cinder.rpc [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 15:27:18 devstack cinder-volume[81699]: INFO cinder.rpc [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_db.sqlalchemy.engines [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:18 devstack cinder-volume[81699]: INFO cinder.volume.manager [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Determined volume DB was empty at startup. Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG cinder.volume.manager [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81699) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 15:27:18 devstack cinder-volume[81699]: WARNING stevedore.named [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 15:27:18 devstack cinder-volume[81699]: WARNING castellan.key_manager [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:27:18 devstack cinder-volume[81699]: WARNING cinder.keymgr.conf_key_mgr [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 15:27:18 devstack cinder-volume[81699]: INFO cinder.volume.manager [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_db.sqlalchemy.engines [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:18 devstack cinder-volume[81699]: INFO oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Starting 1 workers Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Started child 81909 {{(pid=81699) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Full set of CONF: {{(pid=81699) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] ******************************************************************************** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Configuration options gathered from: {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] ================================================================================ {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] allow_availability_zone_fallback = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] allow_compression_on_image_upload = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] allowed_direct_url_schemes = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] api_rate_limit = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] auth_strategy = keystone {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_availability_zone = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_host = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_stats_polling_interval = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backup_api_class = cinder.backup.api.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backup_name_template = backup-%s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backup_use_same_host = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backup_use_temp_snapshot = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] chap_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] chap_username = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_internal_tenant_project_id = 02caebc4d6e846febef2615413e3822f {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_internal_tenant_user_id = 87269b24028f41bd82be3b41c60451f3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cluster = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] compression_format = gzip {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] compute_api_class = cinder.compute.nova.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] config_dir = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] config_source = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] control_exchange = openstack {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81909]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] debug = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] default_availability_zone = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] default_group_type = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] default_volume_type = QuobyteHD {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] disk_geometry = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_client_cert = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_client_cert_key = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_data_namespace = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_ssl_cert_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_ssl_cert_verify = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] driver_use_ssl = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] enable_new_services = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] enable_unsupported_driver = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] enabled_backends = ['QuobyteHD'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] enforce_multipath_for_image_xfer = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] filter_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_api_insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_api_ssl_compression = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_ca_certificates_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_catalog_info = image:glance:publicURL {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_num_retries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance_request_timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] goodness_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] graceful_shutdown_timeout = 5 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] group_api_class = cinder.group.api.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] host = devstack {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_compress_on_upload = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_conversion_address_space_limit = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_conversion_cpu_limit = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_conversion_disable = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_upload_use_cinder_backend = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_upload_use_internal_tenant = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_volume_cache_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_volume_cache_max_count = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] image_volume_cache_max_size_gb = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] init_host_max_objects_retrieval = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] instance_format = [instance: %(uuid)s] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iscsi_target_flags = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iscsi_write_cache = on {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iser_helper = tgtadm {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iser_ip_address = 192.168.122.229 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iser_port = 3260 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_color = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_config_append = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_dir = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_options = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_rotate_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_rotate_interval_type = days {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] log_rotation_type = none {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] max_age = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] max_logfile_count = 30 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] max_logfile_size_mb = 200 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] max_over_subscription_ratio = 20.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] message_reap_interval = 86400 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] message_ttl = 2592000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] migration_create_volume_timeout_secs = 300 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] monkey_patch = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] monkey_patch_modules = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] my_ip = 192.168.122.229 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] no_snapshot_gb_quota = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] num_iser_scan_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] num_shell_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] num_volume_device_scan_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 15:27:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81909) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] nvmeof_conn_info_version = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] nvmet_ns_id = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] nvmet_port_id = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_max_limit = 1000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_ext_list = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_listen = 0.0.0.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_listen_port = 8776 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_use_ssl = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] osapi_volume_workers = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] per_volume_size_limit = -1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] periodic_fuzzy_delay = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] periodic_interval = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] project_id_regex = [0-9a-f\-]+ {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] public_endpoint = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] publish_errors = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_backup_gigabytes = 1000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_backups = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_gigabytes = 1000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_groups = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_snapshots = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] quota_volumes = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] rate_limit_burst = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] rate_limit_except_level = CRITICAL {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] rate_limit_interval = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] reinit_driver_count = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] replication_device = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] report_discard_supported = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] report_interval = 120 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] reservation_clean_interval = 86400 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] reservation_expire = 86400 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] reserved_image_namespaces = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] reserved_percentage = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] rpc_response_timeout = 120 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] run_external_periodic_tasks = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] scst_target_driver = iscsi {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] scst_target_iqn_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_down_time = 720 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] shell_completion = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] snapshot_name_template = snapshot-%s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] split_loggers = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] state_path = /opt/stack/data/cinder {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] storage_availability_zone = nova {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] storage_protocol = iSCSI {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] syslog_log_facility = LOG_USER {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_helper = lioadm {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_ip_address = 192.168.122.229 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_port = 3260 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_protocol = iscsi {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] target_secondary_ip_addresses = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] trace_flags = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] transfer_api_class = cinder.transfer.api.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] transport_url = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] until_refresh = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_chap_auth = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_default_quota_class = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_journal = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_json = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_multipath_for_image_xfer = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_stderr = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] use_syslog = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] verify_glance_signatures = enabled {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_api_class = cinder.volume.api.API {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_backend_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_clear = zero {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_clear_ionice = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_clear_size = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_copy_bps_limit = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_dd_blocksize = 1M {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_name_template = volume-%s {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_service_inithost_offload = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volume_usage_audit_period = month {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] zoning_mode = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_concurrency.disable_process_locking = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.admin_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.admin_token = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.admin_user = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_admin_prefix = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_port = 35357 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_protocol = https {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_section = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_type = password {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_uri = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.auth_version = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.cache = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81909) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 15:27:18 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.delay_auth_decision = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.http_connect_timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:18 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Running cmd (subprocess): mount.quobyte {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.identity_uri = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.include_service_catalog = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.interface = public {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_password = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcache_username = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.region_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.service_token_roles_required = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.service_type = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.token_cache_time = 300 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.backend = dogpile.cache.null {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.backend_argument = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.backend_expiration_time = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.config_prefix = cache.oslo {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.debug_cache_backend = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.enable_retry_client = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.enable_socket_keepalive = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.enforce_fips_mode = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.expiration_time = 600 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.hashclient_retry_attempts = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_dead_retry = 300 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_pool_maxsize = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_sasl_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.proxies = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.redis_db = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.redis_sentinel_service_name = mymaster {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.redis_server = localhost:6379 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.retry_attempts = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.retry_delay = 0.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.socket_keepalive_count = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.socket_keepalive_idle = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.socket_keepalive_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.socket_timeout = 1.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.tls_allowed_ciphers = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.tls_cafile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.tls_certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.tls_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.tls_keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cache.username = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] coordination.backend_url = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.asyncio_connection = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.asyncio_slave_connection = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.backend = sqlalchemy {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.connection = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.connection_debug = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.connection_parameters = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.connection_recycle_time = 3600 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.connection_trace = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.db_inc_retry_interval = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.db_max_retries = 20 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.db_max_retry_interval = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.db_retry_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.max_overflow = 50 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.max_pool_size = 5 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.max_retries = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.mysql_wsrep_sync_wait = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.pool_timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack quobyte-client[81915]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 15:27:19 devstack quobyte-client[81915]: Invalid parameters found, error: missing mount point. Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.retry_interval = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack quobyte-client[81915]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 15:27:19 devstack quobyte-client[81915]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.slave_connection = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.sqlite_synchronous = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.synchronous_reader = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] database.use_db_reconnect = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.connection_string = messaging:// {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.es_doc_type = notification {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.es_scroll_size = 10000 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.es_scroll_time = 2m {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.filter_error_trace = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.hmac_keys = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.sentinel_service_name = mymaster {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.socket_timeout = 0.1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.trace_requests = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler.trace_sqlalchemy = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler_jaeger.process_tags = {} {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler_jaeger.service_name_prefix = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] profiler_otlp.service_name_prefix = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.enforce_new_defaults = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: WARNING oslo_config.cfg [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.enforce_scope = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.policy_default_rule = default {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.policy_file = policy.yaml {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_policy.remote_timeout = 60.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.group = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.helper_command = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] privsep_osbrick.user = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.group = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.helper_command = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] cinder_sys_admin.user = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.auth_section = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.auth_type = password {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.cafile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.collect_timing = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.send_service_user_token = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.split_loggers = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] service_user.timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.auth_section = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.auth_type = password {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.collect_timing = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.region_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.split_loggers = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] glance.timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.backend_availability_zone = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.chap_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.chap_username = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.disk_geometry = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_client_cert = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_client_cert_key = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_data_namespace = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.driver_use_ssl = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.enable_unsupported_driver = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.extra_capabilities = {} {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.filter_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.goodness_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iscsi_target_flags = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iscsi_write_cache = on {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iser_helper = tgtadm {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iser_port = 3260 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_host = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_login = admin {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_mount_options = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_private_key = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_share_path = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_ssh_port = 22 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.num_shell_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.nvmet_port_id = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_client_cfg = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.quobyte_volume_url = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.replication_device = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.report_discard_supported = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.reserved_percentage = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.scst_target_driver = iscsi {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.scst_target_iqn_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.storage_protocol = iSCSI {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_helper = tgtadm {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_port = 3260 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_protocol = iscsi {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.trace_flags = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.unique_fqdn_network = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.use_chap_auth = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_backend_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_clear = zero {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_clear_ionice = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_clear_size = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_reports.file_event_handler = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_reports.log_dir = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.backend_availability_zone = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.backend_host = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.chap_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.chap_username = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.chiscsi_conf = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.disk_geometry = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_client_cert = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_client_cert_key = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_data_namespace = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.driver_use_ssl = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.extra_capabilities = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.filter_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.goodness_function = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iscsi_target_flags = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iscsi_write_cache = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iser_helper = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iser_ip_address = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iser_port = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.iser_target_prefix = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_host = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_login = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_mount_options = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_password = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_private_key = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_share_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_ssh_port = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.num_shell_tries = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nvmet_ns_id = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.nvmet_port_id = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.replication_device = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.report_discard_supported = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.reserved_percentage = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.scst_target_driver = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.storage_protocol = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_helper = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_ip_address = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_port = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_prefix = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_protocol = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.trace_flags = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.unique_fqdn_network = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.use_chap_auth = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_clear = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_clear_ionice = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_clear_size = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] QuobyteHD.volumes_dir = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.ssl_version = {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_notifications.driver = [] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_notifications.retry = -1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] oslo_messaging_notifications.transport_url = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] key_manager.fixed_key = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.barbican_api_version = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.barbican_endpoint = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.barbican_endpoint_type = public {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.barbican_region_name = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.cafile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.collect_timing = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.number_of_retries = 60 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.retry_delay = 1 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.send_service_user_token = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.split_loggers = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.verify_ssl = True {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican.verify_ssl_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.auth_section = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.auth_type = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.cafile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.certfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.collect_timing = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.insecure = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.keyfile = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.split_loggers = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] barbican_service_user.timeout = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.approle_role_id = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.approle_secret_id = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.kv_mountpoint = secret {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.kv_path = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.kv_version = 2 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.namespace = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.root_token_id = **** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.ssl_ca_crt_file = None {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.timeout = 60.0 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.use_ssl = False {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 15:27:19 devstack sudo[81930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:19 devstack cinder-volume[81699]: DEBUG oslo_service.backend._eventlet.service [None req-61e5e9b9-91bc-4fec-becd-b0bf1944122c None None] ******************************************************************************** {{(pid=81699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 15:27:19 devstack sudo[81930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:20 devstack sudo[81930]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.906s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:20 devstack cinder-volume[81909]: INFO cinder.volume.driver [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Driver hasn't implemented _init_vendor_properties() Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG cinder.volume.driver [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309799194336, 'free_capacity_gb': 1775.7309799194336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81909) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_db.sqlalchemy.engines [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81909) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writer thread running {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG cinder.db.sqlalchemy.api [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Building query based on filter {{(pid=81909) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81909) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:20 devstack cinder-volume[81909]: INFO cinder.keymgr.migration [None req-d44f2c01-9083-47da-8747-b7351fc4e922 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 15:27:20 devstack sudo[81978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:20 devstack sudo[81978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:21 devstack sudo[81978]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.220s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:27:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Driver initialization completed successfully. Apr 24 15:27:21 devstack cinder-volume[81909]: INFO cinder.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Initiating service 3 cleanup Apr 24 15:27:21 devstack cinder-volume[81909]: INFO cinder.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Service 3 cleanup completed. Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG cinder.service [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Creating RPC server for service cinder-volume {{(pid=81909) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG cinder.service [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81909) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 15:27:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:27:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:27:21 devstack sudo[81996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:27:21 devstack sudo[81996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:27:22 devstack sudo[81996]: pam_unix(sudo:session): session closed for user root Apr 24 15:27:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.523s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:27:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c235086-aef3-4c8c-8b6b-f001953760eb None None] Driver post RPC initialization completed successfully. Apr 24 15:27:28 devstack cinder-volume[81699]: DEBUG dbcounter [-] [81699] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81699) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:27:31 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:27:32 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=3 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:28:17 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (2482a534-0e0e-4067-a093-5d4dd5c18652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba01c940-9f80-44da-a148-2c0153732163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba01c940-9f80-44da-a148-2c0153732163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805723900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:18Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0729a75e-1123-45b8-9d09-1fb280cc0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0729a75e-1123-45b8-9d09-1fb280cc0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f808c4-6814-49f9-8604-4eefd53cde95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f808c4-6814-49f9-8604-4eefd53cde95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6', 'volume_name': 'volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c919bde-050e-4a34-99ee-dd4aa25db053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c919bde-050e-4a34-99ee-dd4aa25db053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7076db7-91e4-4752-b64a-e70e0926290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:18 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Volume aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6', 'volume_size': 1} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805723900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:18Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Creating volume aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:18 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:18 devstack sudo[82354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 1073741824 Apr 24 15:28:18 devstack sudo[82354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:19 devstack sudo[82354]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 1073741824" returned: 0 in 0.924s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:19 devstack sudo[82690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 Apr 24 15:28:19 devstack sudo[82690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:19 devstack sudo[82690]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" returned: 0 in 0.647s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7076db7-91e4-4752-b64a-e70e0926290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ea0ee-580c-4c63-a0d5-fc68aaa667df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:19 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Volume volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 (aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6): created successfully Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ea0ee-580c-4c63-a0d5-fc68aaa667df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (2482a534-0e0e-4067-a093-5d4dd5c18652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7cf55727-2655-4d9b-a93e-e69bf1582eee tempest-VolumesTestJSON-2062458573 None] Created volume successfully. Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (399b93cb-bbb1-45ef-b3ec-74454adcb6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c1c799-1b6b-49e2-be44-88330c1c8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c1c799-1b6b-49e2-be44-88330c1c8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-418049642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a44ec32-798c-4d01-8fd3-12b98327f96f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:21Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f2a2f8-6bd6-4b68-b71d-7c35c4c9f455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f2a2f8-6bd6-4b68-b71d-7c35c4c9f455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08689a8-4f98-4d2a-b6cc-8974c13f1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08689a8-4f98-4d2a-b6cc-8974c13f1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a44ec32-798c-4d01-8fd3-12b98327f96f', 'volume_name': 'volume-1a44ec32-798c-4d01-8fd3-12b98327f96f', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e17fe95-0a29-436f-9c1e-a16504ac2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e17fe95-0a29-436f-9c1e-a16504ac2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd872e6-ce23-4b2b-a25d-fb4714b6bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Volume 1a44ec32-798c-4d01-8fd3-12b98327f96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a44ec32-798c-4d01-8fd3-12b98327f96f', 'volume_size': 1} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-418049642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a44ec32-798c-4d01-8fd3-12b98327f96f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:21Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Creating volume 1a44ec32-798c-4d01-8fd3-12b98327f96f {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:21 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:21 devstack sudo[82725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f 1073741824 Apr 24 15:28:21 devstack sudo[82725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:22 devstack sudo[82725]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f 1073741824" returned: 0 in 0.979s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:22 devstack sudo[82741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f Apr 24 15:28:22 devstack sudo[82741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:23 devstack sudo[82741]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f" returned: 0 in 0.749s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd872e6-ce23-4b2b-a25d-fb4714b6bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a44ec32-798c-4d01-8fd3-12b98327f96f', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f658ddde-4716-49fe-ad17-dc6d76bb88aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Volume volume-1a44ec32-798c-4d01-8fd3-12b98327f96f (1a44ec32-798c-4d01-8fd3-12b98327f96f): created successfully Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f658ddde-4716-49fe-ad17-dc6d76bb88aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (399b93cb-bbb1-45ef-b3ec-74454adcb6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f42643c1-21fd-4d54-97a2-54e85cf82f9d tempest-VolumesTestJSON-2062458573 None] Created volume successfully. Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (1c042ca1-0b76-4f79-8aa4-9e26dd0348d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525d9a77-cc25-4373-ab4d-e93c871e2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525d9a77-cc25-4373-ab4d-e93c871e2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844987053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d313526b-2916-409c-bf51-b0111d6ed305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:24Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe070b07-692a-4bd9-b22c-bfa4e4d38be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe070b07-692a-4bd9-b22c-bfa4e4d38be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b83d07-5973-4e47-95fa-fed477501c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b83d07-5973-4e47-95fa-fed477501c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd313526b-2916-409c-bf51-b0111d6ed305', 'volume_name': 'volume-d313526b-2916-409c-bf51-b0111d6ed305', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccdb9cd-6d95-4bda-b4cc-068be52d5842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccdb9cd-6d95-4bda-b4cc-068be52d5842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519c8a1-952e-4758-a4d2-993fb0ff039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Volume d313526b-2916-409c-bf51-b0111d6ed305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d313526b-2916-409c-bf51-b0111d6ed305', 'volume_size': 1} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844987053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d313526b-2916-409c-bf51-b0111d6ed305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc6e95c03b4c47bd842a1517fcfeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:24Z,use_quota=True,user_id='3a305a7d1eb2464eb7c1884fe4d26164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Creating volume d313526b-2916-409c-bf51-b0111d6ed305 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:24 devstack sudo[82758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 1073741824 Apr 24 15:28:24 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:25 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 1073741824" returned: 0 in 0.660s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:25 devstack sudo[82766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 Apr 24 15:28:25 devstack sudo[82766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:25 devstack sudo[82766]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305" returned: 0 in 0.514s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519c8a1-952e-4758-a4d2-993fb0ff039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d313526b-2916-409c-bf51-b0111d6ed305', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3096e6f-6803-4603-a8a9-0731075fcd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Volume volume-d313526b-2916-409c-bf51-b0111d6ed305 (d313526b-2916-409c-bf51-b0111d6ed305): created successfully Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3096e6f-6803-4603-a8a9-0731075fcd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Flow 'volume_create_manager' (1c042ca1-0b76-4f79-8aa4-9e26dd0348d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-48542b25-c87c-416a-9981-f099f94d11f4 tempest-VolumesTestJSON-2062458573 None] Created volume successfully. Apr 24 15:28:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-d313526b-2916-409c-bf51-b0111d6ed305-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "cinder-d313526b-2916-409c-bf51-b0111d6ed305-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-quobyte-d313526b-2916-409c-bf51-b0111d6ed305" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-d313526b-2916-409c-bf51-b0111d6ed305" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:27 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprygc6twc/privsep.sock'] Apr 24 15:28:27 devstack sudo[82790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprygc6twc/privsep.sock Apr 24 15:28:27 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 15:28:28 devstack cinder-volume[81909]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 15:28:29 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:29 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Spawned new privsep daemon via rootwrap Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Accepted privsep connection to /tmp/tmprygc6twc/privsep.sock {{(pid=81909) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 15:28:29 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 15:28:29 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 15:28:29 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 15:28:29 devstack cinder-volume[81909]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82800 Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f3cb3-e368-4bd1-b290-4ca3318e70c7]: (2,) {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4696d7af-45b8-4311-8378-ca9f4def0ff0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:29 devstack sudo[82811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 Apr 24 15:28:29 devstack sudo[82811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:29 devstack sudo[82811]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305" returned: 0 in 0.664s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:29 devstack sudo[82826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305 Apr 24 15:28:29 devstack sudo[82826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:30 devstack sudo[82826]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d313526b-2916-409c-bf51-b0111d6ed305" returned: 0 in 0.708s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-d313526b-2916-409c-bf51-b0111d6ed305" released by "delete_volume" :: held 2.905s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:30 devstack cinder-volume[81909]: WARNING cinder.quota [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:28:30 devstack cinder-volume[81909]: WARNING cinder.quota [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Created reservations ['190c829b-bce6-449c-bde0-360bbecb35c8', '5af4af09-4da8-4d06-bd04-f04c0b15af6f', '7da0a8f4-dbca-4169-9334-86dd02e40b03', '4eb13d5d-98e6-4b82-822d-30ead33b5a3f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:30 devstack sudo[82862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:30 devstack sudo[82862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-1a44ec32-798c-4d01-8fd3-12b98327f96f-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-1a44ec32-798c-4d01-8fd3-12b98327f96f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-quobyte-1a44ec32-798c-4d01-8fd3-12b98327f96f" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-1a44ec32-798c-4d01-8fd3-12b98327f96f" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ccb7ce-1d4e-48bb-b06d-7eeb51162d5a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:31 devstack sudo[82865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f Apr 24 15:28:31 devstack sudo[82865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:32 devstack sudo[82862]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.341s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:32 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Deleted volume successfully. Apr 24 15:28:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-50052659-3709-49e6-8ba0-17cb9277746d tempest-VolumesTestJSON-2062458573 None] Lock "cinder-d313526b-2916-409c-bf51-b0111d6ed305-delete_volume" released by "delete_volume" :: held 4.689s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:32 devstack sudo[82865]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f" returned: 0 in 1.065s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:32 devstack sudo[82872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f Apr 24 15:28:32 devstack sudo[82872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:33 devstack sudo[82872]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Flow 'volume_create_manager' (91498b00-a864-45ca-92c9-2074b8c4072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4125a80-21a7-4c05-a774-30b258676c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4125a80-21a7-4c05-a774-30b258676c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:33Z,deleted=False,deleted_at=None,display_description='',display_name='36ed9d39-808e-4765-a086-d8bc96fbad6c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab44e6ad-0ae4-4445-88bc-468913e3546a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c709ea89134f3c9ced327ccf9e7d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:33Z,use_quota=True,user_id='a4ad50da488340efb67781750fb2bd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7118e-93cb-45ed-b918-da9b27a044c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7118e-93cb-45ed-b918-da9b27a044c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ae7596-2457-470c-a9b1-504d76d308a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ae7596-2457-470c-a9b1-504d76d308a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab44e6ad-0ae4-4445-88bc-468913e3546a', 'volume_name': 'volume-ab44e6ad-0ae4-4445-88bc-468913e3546a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fbf096-ba7c-48ee-bb5c-e443751e3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fbf096-ba7c-48ee-bb5c-e443751e3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143acddd-660b-48d6-88e3-e20ab119f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume ab44e6ad-0ae4-4445-88bc-468913e3546a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab44e6ad-0ae4-4445-88bc-468913e3546a', 'volume_size': 1} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:33Z,deleted=False,deleted_at=None,display_description='',display_name='36ed9d39-808e-4765-a086-d8bc96fbad6c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab44e6ad-0ae4-4445-88bc-468913e3546a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c709ea89134f3c9ced327ccf9e7d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:33Z,use_quota=True,user_id='a4ad50da488340efb67781750fb2bd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Creating volume ab44e6ad-0ae4-4445-88bc-468913e3546a {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:33 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a44ec32-798c-4d01-8fd3-12b98327f96f" returned: 0 in 1.213s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-1a44ec32-798c-4d01-8fd3-12b98327f96f" released by "delete_volume" :: held 2.405s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:33 devstack sudo[82876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a 1073741824 Apr 24 15:28:33 devstack sudo[82876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Created reservations ['8dc76110-bf4b-4e13-a4d9-129b7e7ef902', '9a718de3-c280-416d-84f1-2e1b67353036', '3981c5a3-3eb5-4fae-a1da-a747eaf6298d', '9e959557-f061-408c-b7f7-935c3398865c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:33 devstack sudo[82878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:33 devstack sudo[82878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "cinder-quobyte-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" acquired by "delete_volume" :: waited 0.048s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f58ff2d-6900-4dd1-a91a-85a30ca219ea]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:35 devstack sudo[82885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 Apr 24 15:28:35 devstack sudo[82885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:35 devstack sudo[82878]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.316s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:35 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Deleted volume successfully. Apr 24 15:28:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-367f8606-5aee-415c-a1f8-c63b49d393f7 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-1a44ec32-798c-4d01-8fd3-12b98327f96f-delete_volume" released by "delete_volume" :: held 4.058s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:35 devstack sudo[82876]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a 1073741824" returned: 0 in 1.632s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:35 devstack sudo[82887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a Apr 24 15:28:35 devstack sudo[82887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:36 devstack sudo[82885]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" returned: 0 in 1.552s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Flow 'volume_create_manager' (1341ea54-7caa-4c40-bb42-9e521af03e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:36 devstack sudo[82895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6 Apr 24 15:28:36 devstack sudo[82895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd26b99-18e4-442f-ac38-100f1f57bc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd26b99-18e4-442f-ac38-100f1f57bc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1688792889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c779114-7cc6-44dc-bee9-054443cf6d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c8ba9556ec43de811336dcccccd969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:36Z,use_quota=True,user_id='ffbdb29175764bba9492e783d383f15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efa42ba-8dda-4cd5-b42b-e9892f89b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efa42ba-8dda-4cd5-b42b-e9892f89b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d2992d-dee7-4501-bf0b-3cb044b85bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d2992d-dee7-4501-bf0b-3cb044b85bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c779114-7cc6-44dc-bee9-054443cf6d65', 'volume_name': 'volume-9c779114-7cc6-44dc-bee9-054443cf6d65', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec87fc5-5d49-4de2-a1cc-724df8db781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec87fc5-5d49-4de2-a1cc-724df8db781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fea5d9-25f7-4e77-b124-b9ac197c1cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Volume 9c779114-7cc6-44dc-bee9-054443cf6d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c779114-7cc6-44dc-bee9-054443cf6d65', 'volume_size': 1} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:36 devstack sudo[82887]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a" returned: 0 in 1.233s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] <== create_volume: return (2947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.950s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1688792889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c779114-7cc6-44dc-bee9-054443cf6d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c8ba9556ec43de811336dcccccd969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:36Z,use_quota=True,user_id='ffbdb29175764bba9492e783d383f15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Creating volume 9c779114-7cc6-44dc-bee9-054443cf6d65 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:36 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143acddd-660b-48d6-88e3-e20ab119f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab44e6ad-0ae4-4445-88bc-468913e3546a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1b9364-3721-4875-b3c6-233bc2568856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume volume-ab44e6ad-0ae4-4445-88bc-468913e3546a (ab44e6ad-0ae4-4445-88bc-468913e3546a): created successfully Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1b9364-3721-4875-b3c6-233bc2568856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:36 devstack sudo[82897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 1073741824 Apr 24 15:28:36 devstack sudo[82897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Flow 'volume_create_manager' (91498b00-a864-45ca-92c9-2074b8c4072d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-691e4110-0593-46b6-906c-4a566d60164d tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Created volume successfully. Apr 24 15:28:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bce6a4f5-c739-4b7e-9c1d-5162f94a0260 tempest-GroupsV320Test-665277816 None] Group tempest-GroupsV320Test-Group-1251156996: creating Apr 24 15:28:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bce6a4f5-c739-4b7e-9c1d-5162f94a0260 tempest-GroupsV320Test-665277816 None] Group tempest-GroupsV320Test-Group-1251156996: created successfully Apr 24 15:28:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bce6a4f5-c739-4b7e-9c1d-5162f94a0260 tempest-GroupsV320Test-665277816 None] Create group completed successfully. Apr 24 15:28:37 devstack sudo[82895]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" returned: 0 in 0.931s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-quobyte-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6" released by "delete_volume" :: held 2.532s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Created reservations ['d72f2307-bb84-48cd-8731-eedfda9bd35d', '11c5557a-3b95-46c8-bffb-800318f7966f', '60c7ba4f-de21-4738-af3b-7f019a4321de', '601f3eec-5d64-48f2-9e48-bd0036d2326a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:37 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:37 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:37 devstack sudo[82897]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 1073741824" returned: 0 in 1.060s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:37 devstack sudo[82905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 Apr 24 15:28:37 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:37 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:37 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Deleted volume successfully. Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-53fa7e87-8186-4431-9d59-d4a59b904342 tempest-VolumesTestJSON-2062458573 None] Lock "cinder-aebcd0d3-b6ca-4a4e-a567-9d7c02ae69e6-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:38 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65" returned: 0 in 0.632s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fea5d9-25f7-4e77-b124-b9ac197c1cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c779114-7cc6-44dc-bee9-054443cf6d65', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4db893-9fab-443b-bf12-6900adfffd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Volume volume-9c779114-7cc6-44dc-bee9-054443cf6d65 (9c779114-7cc6-44dc-bee9-054443cf6d65): created successfully Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4db893-9fab-443b-bf12-6900adfffd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Flow 'volume_create_manager' (1341ea54-7caa-4c40-bb42-9e521af03e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3d177378-7745-4a24-b6a5-b9dcee4c3eea tempest-VolumesAdminNegativeTest-1655346213 None] Created volume successfully. Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Created reservations ['472c8975-208d-49cc-b628-84a0e7ec386c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Acquiring lock "cinder-9c779114-7cc6-44dc-bee9-054443cf6d65-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "cinder-9c779114-7cc6-44dc-bee9-054443cf6d65-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Acquiring lock "cinder-quobyte-9c779114-7cc6-44dc-bee9-054443cf6d65" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:39 devstack sudo[82910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:39 devstack sudo[82910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "cinder-quobyte-9c779114-7cc6-44dc-bee9-054443cf6d65" acquired by "delete_volume" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6f342e-a7a5-4acc-9466-1402f5b762f9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:39 devstack sudo[82912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 Apr 24 15:28:39 devstack sudo[82912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:40 devstack sudo[82912]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65" returned: 0 in 1.316s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:40 devstack sudo[82922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65 Apr 24 15:28:40 devstack sudo[82922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:40 devstack sudo[82910]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:40 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:40 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3e483d47-375a-4f52-917f-f02dc0182bff tempest-GroupsV320Test-665277816 None] Delete group completed successfully. Apr 24 15:28:41 devstack sudo[82922]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9c779114-7cc6-44dc-bee9-054443cf6d65" returned: 0 in 0.805s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "cinder-quobyte-9c779114-7cc6-44dc-bee9-054443cf6d65" released by "delete_volume" :: held 2.175s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Created reservations ['f44317af-df99-4340-9480-c3b97c0b076c', '2d89a682-6a53-40b9-8337-9a4391bc0007', '4b04dce7-0522-47ca-abbc-b5160d8e2b91', 'efe808c5-73f0-40b7-9f71-2b1a4df144ac'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:41 devstack sudo[82926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:41 devstack sudo[82926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:42 devstack cinder-volume[81909]: WARNING py.warnings [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 15:28:42 devstack cinder-volume[81909]: .first() Apr 24 15:28:42 devstack cinder-volume[81909]: Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec7da01-b458-4b7a-8f3b-187a3eaed91a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:42 devstack sudo[82941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a Apr 24 15:28:42 devstack sudo[82941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:42 devstack sudo[82926]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.075s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:42 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:43 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Deleted volume successfully. Apr 24 15:28:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-608f01ab-5f0e-4409-abf0-66386cd94a5c tempest-VolumesAdminNegativeTest-1655346213 None] Lock "cinder-9c779114-7cc6-44dc-bee9-054443cf6d65-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:28:43 devstack sudo[82941]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a" returned: 0 in 0.950s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e', 'name': 'volume-ab44e6ad-0ae4-4445-88bc-468913e3546a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1477818f-7f78-4a3f-90c1-00d71853ce3c', 'enforce_multipath': True} {{(pid=81909) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 15:28:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-497f63fe-b00e-4f4b-8755-4b2eae3fe1f0 req-25bf152a-ef9c-42fb-95db-d200422a5666 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] attachment_update completed successfully. Apr 24 15:28:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9f93ef8b-b7d0-4877-81db-cb86888410f7 tempest-GroupSnapshotsV319Test-1315764605 None] Group tempest-GroupSnapshotsV319Test-Group-144547968: creating Apr 24 15:28:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9f93ef8b-b7d0-4877-81db-cb86888410f7 tempest-GroupSnapshotsV319Test-1315764605 None] Group tempest-GroupSnapshotsV319Test-Group-144547968: created successfully Apr 24 15:28:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9f93ef8b-b7d0-4877-81db-cb86888410f7 tempest-GroupSnapshotsV319Test-1315764605 None] Create group completed successfully. Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:49 devstack sudo[83404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:28:49 devstack sudo[83404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:49 devstack sudo[83404]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.592s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:28:49 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Flow 'volume_create_manager' (74c409ab-0ff0-4224-bf8f-9fbede2bb2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15600c46-db57-4e00-bc9c-8dfb7b5dcb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15600c46-db57-4e00-bc9c-8dfb7b5dcb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480180579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d70a255-2b9a-4ca6-bbd6-32bbafee3fb3,host='devstack@QuobyteHD#QuobyteHD',id=a2b784ef-4d53-4646-ab5a-10953dd0eaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d584cf57195248eb92c8cde0e32221a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:50Z,use_quota=True,user_id='89ac4e2e124648f28e7b215c28477c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e6c8722-7b2c-4c01-ad6b-1ba18ce6e9ec),volume_type_id=2e6c8722-7b2c-4c01-ad6b-1ba18ce6e9ec)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7581414b-7fb4-4381-b874-2e5fed3ea585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7581414b-7fb4-4381-b874-2e5fed3ea585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da91829-cfbd-4fe0-9cc6-0afd7a327c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da91829-cfbd-4fe0-9cc6-0afd7a327c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b784ef-4d53-4646-ab5a-10953dd0eaf6', 'volume_name': 'volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5588db5-1616-49db-8a0a-cd275775a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5588db5-1616-49db-8a0a-cd275775a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60818733-f669-4ac2-a65c-0df8c34af072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:50 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Volume a2b784ef-4d53-4646-ab5a-10953dd0eaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6', 'volume_size': 1} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d70a255-2b9a-4ca6-bbd6-32bbafee3fb3,created_at=2026-04-24T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480180579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d70a255-2b9a-4ca6-bbd6-32bbafee3fb3,host='devstack@QuobyteHD#QuobyteHD',id=a2b784ef-4d53-4646-ab5a-10953dd0eaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d584cf57195248eb92c8cde0e32221a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:28:50Z,use_quota=True,user_id='89ac4e2e124648f28e7b215c28477c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e6c8722-7b2c-4c01-ad6b-1ba18ce6e9ec),volume_type_id=2e6c8722-7b2c-4c01-ad6b-1ba18ce6e9ec)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Creating volume a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:28:50 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:50 devstack sudo[83416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 1073741824 Apr 24 15:28:50 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:50 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 1073741824" returned: 0 in 0.780s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:51 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 Apr 24 15:28:51 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:51 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60818733-f669-4ac2-a65c-0df8c34af072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f062e-03d8-428e-a15d-de2fd8e924b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:28:51 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Volume volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 (a2b784ef-4d53-4646-ab5a-10953dd0eaf6): created successfully Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f062e-03d8-428e-a15d-de2fd8e924b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:28:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Flow 'volume_create_manager' (74c409ab-0ff0-4224-bf8f-9fbede2bb2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:28:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b41032a3-cd47-4c89-ad0d-a8ea3ac64eec tempest-GroupSnapshotsV319Test-1315764605 None] Created volume successfully. Apr 24 15:28:52 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] GroupSnapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: creating. Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Group snapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: creating. {{(pid=81909) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Creating offline snapshot edd2bceb-d027-46e0-863d-133eb01d0d21 of volume a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a070c7e-46c7-4436-8bae-515fa51b752d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:52 devstack sudo[83461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 Apr 24 15:28:52 devstack sudo[83461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:53 devstack sudo[83461]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" returned: 0 in 0.732s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:53 devstack sudo[83468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 1G Apr 24 15:28:53 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:54 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 1G" returned: 0 in 0.814s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:54 devstack sudo[83473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 Apr 24 15:28:54 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:55 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21" returned: 0 in 0.882s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:55 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:28:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:55 devstack sudo[83479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 Apr 24 15:28:55 devstack sudo[83479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:55 devstack sudo[83479]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21" returned: 0 in 0.742s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:56 devstack sudo[83484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info Apr 24 15:28:56 devstack sudo[83484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:56 devstack sudo[83484]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info" returned: 0 in 0.502s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:56 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:28:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:56 devstack sudo[83487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info Apr 24 15:28:56 devstack sudo[83487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:57 devstack sudo[83487]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.info" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.334s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:28:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5fcc45c3-1cc8-4624-aa28-9d5ae36d1d00 tempest-GroupSnapshotsV319Test-1315764605 None] group_snapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: created successfully Apr 24 15:28:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] group_snapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: deleting Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] group_snapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: deleting {{(pid=81909) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "cinder-quobyte-edd2bceb-d027-46e0-863d-133eb01d0d21" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-edd2bceb-d027-46e0-863d-133eb01d0d21" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Deleting offline snapshot edd2bceb-d027-46e0-863d-133eb01d0d21 of volume a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] snapshot_file for this snap is: volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3f8c7-4c3d-448c-9255-7684f57ccf44]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:58 devstack sudo[83491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 Apr 24 15:28:58 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:28:59 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root Apr 24 15:28:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21" returned: 0 in 0.725s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:28:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:28:59 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[512aa06f-40fd-466f-9ab2-a44c14bc98f7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:28:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:28:59 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 Apr 24 15:28:59 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:00 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" returned: 0 in 0.948s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:00 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 Apr 24 15:29:00 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:01 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21" returned: 0 in 0.910s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:01 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21 Apr 24 15:29:01 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:02 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6.edd2bceb-d027-46e0-863d-133eb01d0d21" returned: 0 in 0.829s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-edd2bceb-d027-46e0-863d-133eb01d0d21" released by "_delete_snapshot" :: held 3.563s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" released by "delete_snapshot" :: held 3.601s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:02 devstack cinder-volume[81909]: WARNING cinder.quota [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-196816242 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-196816242, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:02 devstack cinder-volume[81909]: WARNING cinder.quota [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-196816242 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-196816242, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:02 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] Created reservations ['12950ea1-9f89-48ba-abce-b14b2c6fc422', '08b8c252-122c-40e9-96c2-cb6b0718d5a1', '15d18e4b-5862-40b6-b328-f31a27b5025d', '3b186362-9a46-45b9-b4a8-a44b9f0e3826'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f7dbfb29-87b8-4946-aeb3-d801d1b13c21 tempest-GroupSnapshotsV319Test-1315764605 None] group_snapshot 1794e0e1-fd04-4c41-898e-df8a2ceb4b33: deleted successfully Apr 24 15:29:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" acquired by "delete_volume" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadd590c-86ce-4277-8821-1cfd19eca4ce]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:29:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:03 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 Apr 24 15:29:03 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:04 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" returned: 0 in 0.775s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:04 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6 Apr 24 15:29:04 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:04 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" returned: 0 in 0.542s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "cinder-quobyte-a2b784ef-4d53-4646-ab5a-10953dd0eaf6" released by "delete_volume" :: held 1.409s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Created reservations ['e200a017-4f8d-4547-9a12-1dfdc684660f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:04 devstack cinder-volume[81909]: WARNING cinder.quota [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-196816242 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-196816242, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:04 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Created reservations ['beb24f32-f7cb-4ce6-ba89-dbc38d549917', 'a582eefc-36b1-4e90-8db6-61265710b48c', 'd98eec12-5d6e-4e0c-9fdc-efe3ca1d69bf', '37503dad-a5fa-4ac0-b78f-4430c1f68da3'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:05 devstack sudo[83569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:05 devstack sudo[83569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:05 devstack sudo[83569]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.604s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:05 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:05 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e8715465-512d-42a2-9a35-2fb69bffd751 tempest-GroupSnapshotsV319Test-1315764605 None] Delete group completed successfully. Apr 24 15:29:12 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=81,cinder:SELECT=72,cinder:INSERT=12,cinder:DELETE=7 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:29:12 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=64,cinder:UPDATE=70,cinder:INSERT=21,cinder:DELETE=3 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Flow 'volume_create_manager' (00a411d4-08cf-4854-849e-2d88b03aad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cc674d-8faa-4a8c-88e0-8a16bdc42ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cc674d-8faa-4a8c-88e0-8a16bdc42ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-177829276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a16ae-9d41-4900-8690-7d146b3134c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb0aecdbd4040e4b708baa5e0d6e1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:13Z,use_quota=True,user_id='324851de78eb42d4aa22f2167d01f0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a6cc53-e4b6-4304-99d5-4873813e0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a6cc53-e4b6-4304-99d5-4873813e0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee127883-9d25-4807-8d86-0eef5c325aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee127883-9d25-4807-8d86-0eef5c325aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0a16ae-9d41-4900-8690-7d146b3134c5', 'volume_name': 'volume-fa0a16ae-9d41-4900-8690-7d146b3134c5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3474883-edb7-4013-9c81-96498efa9e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3474883-edb7-4013-9c81-96498efa9e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caa28fe-127d-4c00-8dbf-8454548e875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:13 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Volume fa0a16ae-9d41-4900-8690-7d146b3134c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0a16ae-9d41-4900-8690-7d146b3134c5', 'volume_size': 1} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-177829276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a16ae-9d41-4900-8690-7d146b3134c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb0aecdbd4040e4b708baa5e0d6e1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:13Z,use_quota=True,user_id='324851de78eb42d4aa22f2167d01f0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Creating volume fa0a16ae-9d41-4900-8690-7d146b3134c5 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:29:13 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:29:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:13 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 1073741824 Apr 24 15:29:13 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:14 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 1073741824" returned: 0 in 1.421s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:14 devstack sudo[83655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 Apr 24 15:29:14 devstack sudo[83655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:15 devstack sudo[83655]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5" returned: 0 in 0.697s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caa28fe-127d-4c00-8dbf-8454548e875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0a16ae-9d41-4900-8690-7d146b3134c5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66138227-1dfa-47a2-bf22-236cdf46e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:15 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Volume volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 (fa0a16ae-9d41-4900-8690-7d146b3134c5): created successfully Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66138227-1dfa-47a2-bf22-236cdf46e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Flow 'volume_create_manager' (00a411d4-08cf-4854-849e-2d88b03aad96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:15 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b9c958c0-7be7-4b9d-a269-17b2ea4d8815 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Created volume successfully. Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Acquiring lock "cinder-fa0a16ae-9d41-4900-8690-7d146b3134c5-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "cinder-fa0a16ae-9d41-4900-8690-7d146b3134c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Acquiring lock "cinder-quobyte-fa0a16ae-9d41-4900-8690-7d146b3134c5" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "cinder-quobyte-fa0a16ae-9d41-4900-8690-7d146b3134c5" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93c1e3-170e-446d-bdf7-604571123dcb]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:29:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:17 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 Apr 24 15:29:17 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:18 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5" returned: 0 in 0.884s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:18 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5 Apr 24 15:29:18 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:19 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fa0a16ae-9d41-4900-8690-7d146b3134c5" returned: 0 in 0.916s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "cinder-quobyte-fa0a16ae-9d41-4900-8690-7d146b3134c5" released by "delete_volume" :: held 1.879s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Created reservations ['1b9393c8-70be-4915-be78-f8b0c461906f', 'ef892077-b5f4-4d3e-88cc-c4ecbaf2c08e', '516217a2-8ea6-4d3b-9cc3-0e16ca0246c8', '9349cc9a-9ab5-4f63-b2d7-40ae51009dcd'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:19 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:19 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:20 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.692s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:20 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Deleted volume successfully. Apr 24 15:29:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-afba8982-66bc-44f2-b0fc-81c25b399292 tempest-VolumeQuotasNegativeTestJSON-881591868 None] Lock "cinder-fa0a16ae-9d41-4900-8690-7d146b3134c5-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-83295c8f-cf21-484b-a4da-7a1c4a17bc95 tempest-GroupsTest-1349756256 None] Group tempest-Group1-1408939679: creating Apr 24 15:29:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-83295c8f-cf21-484b-a4da-7a1c4a17bc95 tempest-GroupsTest-1349756256 None] Group tempest-Group1-1408939679: created successfully Apr 24 15:29:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-83295c8f-cf21-484b-a4da-7a1c4a17bc95 tempest-GroupsTest-1349756256 None] Create group completed successfully. Apr 24 15:29:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-50f29fff-33e6-4a63-ac80-fef18ac0d109 tempest-GroupsTest-1349756256 None] Group tempest-Group2-2129222316: creating Apr 24 15:29:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-50f29fff-33e6-4a63-ac80-fef18ac0d109 tempest-GroupsTest-1349756256 None] Group tempest-Group2-2129222316: created successfully Apr 24 15:29:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-50f29fff-33e6-4a63-ac80-fef18ac0d109 tempest-GroupsTest-1349756256 None] Create group completed successfully. Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (57f5bd1c-c30a-4caa-bffa-a3f662736486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c533308-3bd5-44e3-be2c-078a93456f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c533308-3bd5-44e3-be2c-078a93456f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907221325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e667fe1-a610-4169-87a7-96b73c5c3a0e,host='devstack@QuobyteHD#QuobyteHD',id=9506668f-5f52-40b9-b721-bea584f61126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:24Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d85f2f-3712-4493-bb78-1ffcc1cbd53d),volume_type_id=81d85f2f-3712-4493-bb78-1ffcc1cbd53d)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902a883b-ab3b-4244-8d0b-c659e40f5d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902a883b-ab3b-4244-8d0b-c659e40f5d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c20d5-f6ec-4cf6-bda5-46f7c7349753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c20d5-f6ec-4cf6-bda5-46f7c7349753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9506668f-5f52-40b9-b721-bea584f61126', 'volume_name': 'volume-9506668f-5f52-40b9-b721-bea584f61126', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fe8fcb-4000-45ed-93f9-2d42f36d83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fe8fcb-4000-45ed-93f9-2d42f36d83a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe141388-ddb3-43cb-9ebf-c32853a8b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Volume 9506668f-5f52-40b9-b721-bea584f61126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9506668f-5f52-40b9-b721-bea584f61126', 'volume_size': 1} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e667fe1-a610-4169-87a7-96b73c5c3a0e,created_at=2026-04-24T13:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907221325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e667fe1-a610-4169-87a7-96b73c5c3a0e,host='devstack@QuobyteHD#QuobyteHD',id=9506668f-5f52-40b9-b721-bea584f61126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:24Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d85f2f-3712-4493-bb78-1ffcc1cbd53d),volume_type_id=81d85f2f-3712-4493-bb78-1ffcc1cbd53d)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Creating volume 9506668f-5f52-40b9-b721-bea584f61126 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:29:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:29:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:24 devstack sudo[83761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 1073741824 Apr 24 15:29:24 devstack sudo[83761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:25 devstack sudo[83761]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 1073741824" returned: 0 in 0.809s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:25 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 Apr 24 15:29:25 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:26 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126" returned: 0 in 0.557s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe141388-ddb3-43cb-9ebf-c32853a8b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9506668f-5f52-40b9-b721-bea584f61126', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fe4da4-8ccd-4cd6-8e6e-9a49c7e52104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Volume volume-9506668f-5f52-40b9-b721-bea584f61126 (9506668f-5f52-40b9-b721-bea584f61126): created successfully Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fe4da4-8ccd-4cd6-8e6e-9a49c7e52104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (57f5bd1c-c30a-4caa-bffa-a3f662736486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bab85c10-3655-4e66-9267-1f46942352cf tempest-GroupsTest-1349756256 None] Created volume successfully. Apr 24 15:29:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Acquiring lock "cinder-quobyte-9506668f-5f52-40b9-b721-bea584f61126" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-9506668f-5f52-40b9-b721-bea584f61126" acquired by "delete_volume" :: waited 0.037s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:27 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1ac3d-ddcb-4b5e-9762-aad0b1cec852]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:29:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:27 devstack sudo[83770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 Apr 24 15:29:27 devstack sudo[83770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:28 devstack sudo[83770]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126" returned: 0 in 0.810s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:28 devstack sudo[83775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126 Apr 24 15:29:28 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:28 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9506668f-5f52-40b9-b721-bea584f61126" returned: 0 in 0.574s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-9506668f-5f52-40b9-b721-bea584f61126" released by "delete_volume" :: held 1.427s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:28 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Created reservations ['033e7b3d-ee4b-4bab-bcfb-701577275553'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:28 devstack cinder-volume[81909]: WARNING cinder.quota [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-491102202 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-491102202, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:28 devstack cinder-volume[81909]: WARNING cinder.quota [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-491102202 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-491102202, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Created reservations ['8e98b5e5-cb93-4799-b6e9-b4f1f22286b4', 'eb4f9385-c3eb-48ad-ba5d-0da90179d0c2', 'fc473cee-183b-4bd1-9ccf-9573a0caf582', '2ddce316-ffcb-485f-a5d0-4705d533ce05'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:29 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:29 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Created reservations ['685a0afd-907c-4f9e-914f-124856db8f72'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:29 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:29 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:29 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.789s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:30 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b073e194-e394-43d7-b436-7d9b70e798cc tempest-GroupsTest-1349756256 None] Delete group completed successfully. Apr 24 15:29:30 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.783s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:30 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-057573e7-4633-449b-8d35-71149f3d2380 tempest-GroupsTest-1349756256 None] Delete group completed successfully. Apr 24 15:29:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8c9454cc-c0f5-4e86-800b-d8e6e1eda101 tempest-GroupsTest-1349756256 None] Group tempest-GroupsTest-Group-1006347951: creating Apr 24 15:29:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8c9454cc-c0f5-4e86-800b-d8e6e1eda101 tempest-GroupsTest-1349756256 None] Group tempest-GroupsTest-Group-1006347951: created successfully Apr 24 15:29:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8c9454cc-c0f5-4e86-800b-d8e6e1eda101 tempest-GroupsTest-1349756256 None] Create group completed successfully. Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (9b64673b-e3c0-441e-bbee-d37f4596a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72b1953-f687-4d2a-a08d-9db930d420a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72b1953-f687-4d2a-a08d-9db930d420a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-544040163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2047f864-6f47-4fad-99f3-1d7159af2f47,host='devstack@QuobyteHD#QuobyteHD',id=31ca139a-487f-4cb3-a70f-1ab7c9ce830c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:33Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c73a154-8c20-4b3a-b9d1-b7ca50a37894),volume_type_id=6c73a154-8c20-4b3a-b9d1-b7ca50a37894)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e04c5fc-0c38-43a4-9dfe-039ac4e1296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e04c5fc-0c38-43a4-9dfe-039ac4e1296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c0cbb-d20a-4754-9641-dd7462b41e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c0cbb-d20a-4754-9641-dd7462b41e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ca139a-487f-4cb3-a70f-1ab7c9ce830c', 'volume_name': 'volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2570748-e4cd-4933-9a14-4e2ff907ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2570748-e4cd-4933-9a14-4e2ff907ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0e188-e5aa-460e-924e-f14afc1e0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Volume 31ca139a-487f-4cb3-a70f-1ab7c9ce830c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c', 'volume_size': 1} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2047f864-6f47-4fad-99f3-1d7159af2f47,created_at=2026-04-24T13:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-544040163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2047f864-6f47-4fad-99f3-1d7159af2f47,host='devstack@QuobyteHD#QuobyteHD',id=31ca139a-487f-4cb3-a70f-1ab7c9ce830c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:33Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c73a154-8c20-4b3a-b9d1-b7ca50a37894),volume_type_id=6c73a154-8c20-4b3a-b9d1-b7ca50a37894)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Creating volume 31ca139a-487f-4cb3-a70f-1ab7c9ce830c {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:29:33 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:29:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:33 devstack sudo[83815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c 1073741824 Apr 24 15:29:33 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:33 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c 1073741824" returned: 0 in 0.883s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:34 devstack sudo[83823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c Apr 24 15:29:34 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:34 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" returned: 0 in 0.557s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0e188-e5aa-460e-924e-f14afc1e0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64295a71-21d3-4f08-9f6d-b3712a498457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:34 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Volume volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c (31ca139a-487f-4cb3-a70f-1ab7c9ce830c): created successfully Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64295a71-21d3-4f08-9f6d-b3712a498457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (9b64673b-e3c0-441e-bbee-d37f4596a040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-59a62562-4abc-4a57-8e03-c1d7298d5d64 tempest-GroupsTest-1349756256 None] Created volume successfully. Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (6a7d4ec0-7f42-4952-9396-5f9da8693c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a4097c-4b32-43e3-94ca-49e450a9c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a4097c-4b32-43e3-94ca-49e450a9c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505579761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2047f864-6f47-4fad-99f3-1d7159af2f47,host='devstack@QuobyteHD#QuobyteHD',id=411cd42c-56b8-49cd-b793-0ce7ed82f091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:36Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c73a154-8c20-4b3a-b9d1-b7ca50a37894),volume_type_id=6c73a154-8c20-4b3a-b9d1-b7ca50a37894)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0270ed-dedb-4e75-b86d-00bbaf6092fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0270ed-dedb-4e75-b86d-00bbaf6092fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b344f943-cabc-4b65-9500-b29026c3fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b344f943-cabc-4b65-9500-b29026c3fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411cd42c-56b8-49cd-b793-0ce7ed82f091', 'volume_name': 'volume-411cd42c-56b8-49cd-b793-0ce7ed82f091', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42802801-630f-48f4-886c-65278d05df31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42802801-630f-48f4-886c-65278d05df31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3800500-902c-4ccf-80aa-00d0f64f50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:35 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Volume 411cd42c-56b8-49cd-b793-0ce7ed82f091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411cd42c-56b8-49cd-b793-0ce7ed82f091', 'volume_size': 1} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2047f864-6f47-4fad-99f3-1d7159af2f47,created_at=2026-04-24T13:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505579761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2047f864-6f47-4fad-99f3-1d7159af2f47,host='devstack@QuobyteHD#QuobyteHD',id=411cd42c-56b8-49cd-b793-0ce7ed82f091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7ebfc174a42f1a58a9b2c7c0457f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:36Z,use_quota=True,user_id='8e9ff588b20a4e438a2f99c515ec3c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c73a154-8c20-4b3a-b9d1-b7ca50a37894),volume_type_id=6c73a154-8c20-4b3a-b9d1-b7ca50a37894)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Creating volume 411cd42c-56b8-49cd-b793-0ce7ed82f091 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:29:35 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:29:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:35 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 1073741824 Apr 24 15:29:35 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:36 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 1073741824" returned: 0 in 0.785s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:36 devstack sudo[83846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 Apr 24 15:29:36 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:37 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091" returned: 0 in 0.640s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3800500-902c-4ccf-80aa-00d0f64f50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411cd42c-56b8-49cd-b793-0ce7ed82f091', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c1ce0b-f9bf-42a3-a434-ca48513ee84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:37 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Volume volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 (411cd42c-56b8-49cd-b793-0ce7ed82f091): created successfully Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c1ce0b-f9bf-42a3-a434-ca48513ee84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Flow 'volume_create_manager' (6a7d4ec0-7f42-4952-9396-5f9da8693c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e9859916-a5ce-4045-8995-1cbb4a6bb3ed tempest-GroupsTest-1349756256 None] Created volume successfully. Apr 24 15:29:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-81e50629-0052-42bb-812f-f94ee3fdc6b0 tempest-GroupsTest-1349756256 None] Update group completed successfully. Apr 24 15:29:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a0e8b452-dca9-44d3-9078-715ff73f6365 tempest-GroupsTest-1349756256 None] Update group completed successfully. Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Acquiring lock "cinder-quobyte-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9347b5-67f0-4bd6-b55d-8fd654e29286]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:41 devstack sudo[83855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c Apr 24 15:29:41 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:41 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" returned: 0 in 0.683s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:41 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c Apr 24 15:29:41 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:42 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" returned: 0 in 0.665s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-31ca139a-487f-4cb3-a70f-1ab7c9ce830c" released by "delete_volume" :: held 1.425s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Acquiring lock "cinder-quobyte-411cd42c-56b8-49cd-b793-0ce7ed82f091" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-411cd42c-56b8-49cd-b793-0ce7ed82f091" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e92d1-c4d8-4e16-978f-21581b6f1af4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:29:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:42 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 Apr 24 15:29:42 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:43 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091" returned: 0 in 0.661s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:43 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091 Apr 24 15:29:43 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:43 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-411cd42c-56b8-49cd-b793-0ce7ed82f091" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "cinder-quobyte-411cd42c-56b8-49cd-b793-0ce7ed82f091" released by "delete_volume" :: held 1.337s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:29:45 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Created reservations ['aead17f9-683e-46ff-a985-2aefb3dbdf9c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:45 devstack cinder-volume[81909]: WARNING cinder.quota [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-186089740 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-186089740, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:45 devstack cinder-volume[81909]: WARNING cinder.quota [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-186089740 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-186089740, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:29:45 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Created reservations ['8c5b1d68-eaec-4f18-80a6-c90162bd7cf0', '4d451455-fd51-4389-a196-6e367b55b398', 'fd8b6a2e-71ed-4855-909e-260f7d7adcd3', '668a4a48-d0dc-483c-ae8f-fbccb157f9ec'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:49 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:49 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:49 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.450s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Created reservations ['21a13387-9e41-4112-a763-e97ff035fca5', '1ffa20c1-a3fe-4f7d-bec4-251e695856ee', 'abaa4050-95b0-4404-8e22-f8bbd9951eb5', '3b3a0a75-3012-44ae-8daa-7fdadc4e95a4'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:50 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:29:50 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:29:51 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Apr 24 15:29:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.623s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:29:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:29:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-55472607-b0af-40c4-bb1c-3b07684c753b tempest-GroupsTest-1349756256 None] Delete group completed successfully. Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Flow 'volume_create_manager' (83412d5d-4293-4426-9e66-24c79c842124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28054f-5a1b-41f7-a734-6f8e188678ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28054f-5a1b-41f7-a734-6f8e188678ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1250298707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18fc986-727e-4658-9163-d1b4253fd887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98636cc2108540c3af18bf087428e954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:59Z,use_quota=True,user_id='8c763494e6f449b0a37090a2078b4277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25806675-a403-4a23-b6db-be01971a5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25806675-a403-4a23-b6db-be01971a5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87183a51-51ee-4fd9-bbb6-f477c9cc742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87183a51-51ee-4fd9-bbb6-f477c9cc742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18fc986-727e-4658-9163-d1b4253fd887', 'volume_name': 'volume-d18fc986-727e-4658-9163-d1b4253fd887', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b36dab-e8ca-40f9-87c6-7dde808fb1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b36dab-e8ca-40f9-87c6-7dde808fb1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277549bb-4cd6-4444-8271-50e8c4b0100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:29:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Volume d18fc986-727e-4658-9163-d1b4253fd887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18fc986-727e-4658-9163-d1b4253fd887', 'volume_size': 1} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1250298707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18fc986-727e-4658-9163-d1b4253fd887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98636cc2108540c3af18bf087428e954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:29:59Z,use_quota=True,user_id='8c763494e6f449b0a37090a2078b4277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Creating volume d18fc986-727e-4658-9163-d1b4253fd887 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:29:58 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:29:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:29:59 devstack sudo[84020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 1073741824 Apr 24 15:29:59 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:00 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 1073741824" returned: 0 in 1.814s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:00 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 Apr 24 15:30:00 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:02 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887" returned: 0 in 1.448s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] <== create_volume: return (3386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.389s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277549bb-4cd6-4444-8271-50e8c4b0100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18fc986-727e-4658-9163-d1b4253fd887', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc7d9f0-6591-4680-b0b5-f95c951def62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:02 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Volume volume-d18fc986-727e-4658-9163-d1b4253fd887 (d18fc986-727e-4658-9163-d1b4253fd887): created successfully Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc7d9f0-6591-4680-b0b5-f95c951def62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Flow 'volume_create_manager' (83412d5d-4293-4426-9e66-24c79c842124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e3931b56-a010-4f63-bfd0-3d6b816c6ca1 tempest-DeleteServersTestJSON-608989456 None] Created volume successfully. Apr 24 15:30:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed92f8e-01b1-48a9-8e2e-81391a4e004d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:08 devstack sudo[84117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 Apr 24 15:30:08 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:09 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887" returned: 0 in 0.979s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e', 'name': 'volume-d18fc986-727e-4658-9163-d1b4253fd887', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78246219-69c3-4b15-ad0f-7015fde90b1d', 'enforce_multipath': True} {{(pid=81909) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 15:30:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-c2672e93-7f05-4da3-af90-956610275b0c req-95731e27-7824-48d0-bb5f-01bf8f3a8aec tempest-DeleteServersTestJSON-608989456 None] attachment_update completed successfully. Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=63,cinder:UPDATE=58,cinder:INSERT=11,cinder:DELETE=2 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=52,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=4 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:30:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-47649ea8-acfb-469d-bfa4-e52362c16f72 req-3d32a952-fc8a-48a0-a3c9-99ee6d5c09fb tempest-DeleteServersTestJSON-608989456 None] Terminate volume connection completed successfully. Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-47649ea8-acfb-469d-bfa4-e52362c16f72 req-3d32a952-fc8a-48a0-a3c9-99ee6d5c09fb tempest-DeleteServersTestJSON-608989456 None] Deleting attachment 78246219-69c3-4b15-ad0f-7015fde90b1d. {{(pid=81909) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Flow 'volume_create_manager' (971c66cf-9bd0-46f7-96cb-833ed17cf122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f554a7-fe9c-4f99-ad71-0178f19d04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f554a7-fe9c-4f99-ad71-0178f19d04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:19Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4767e8-e575-4325-a0bd-03ca69b8d24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c709ea89134f3c9ced327ccf9e7d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:20Z,use_quota=True,user_id='a4ad50da488340efb67781750fb2bd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cda7e45-14ef-43b9-94ea-66a6e2335a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cda7e45-14ef-43b9-94ea-66a6e2335a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0da082-e260-4b5c-851f-a42f98eb0869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:19 devstack cinder-volume[81909]: DEBUG cinder.image.glance [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Creating Keystone auth plugin from conf {{(pid=81909) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0da082-e260-4b5c-851f-a42f98eb0869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b4767e8-e575-4325-a0bd-03ca69b8d24c', 'volume_name': 'volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04ee319-a28e-4e3e-9502-5750eb71c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04ee319-a28e-4e3e-9502-5750eb71c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822c3332-3b39-4d16-bfd5-ce819a21ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Trying to clone 5b4767e8-e575-4325-a0bd-03ca69b8d24c from image 35d86ae8-c267-4804-98fd-3c88f2d8852d at location (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]). {{(pid=81909) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 15:30:20 devstack cinder-volume[81909]: INFO cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Image download 20.69 MB at 20.69 MB/s Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9506448b-bc80-48d2-98ae-e1197cba67cf]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:21 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD Apr 24 15:30:21 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:21 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:21 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d is fetched for user a4ad50da488340efb67781750fb2bd85. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 15:30:21 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75ff53-d084-47d4-965a-a2bc404a3192]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:21 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD Apr 24 15:30:21 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:22 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:19Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4767e8-e575-4325-a0bd-03ca69b8d24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c709ea89134f3c9ced327ccf9e7d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:20Z,use_quota=True,user_id='a4ad50da488340efb67781750fb2bd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Creating volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:22 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:22 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1073741824 Apr 24 15:30:22 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Flow 'volume_create_manager' (56081f2d-0c97-46e7-b161-c169c41316ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58886d-094b-4f82-b3b5-4a9b3812404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58886d-094b-4f82-b3b5-4a9b3812404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2012383980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008420f-8abf-4557-86c5-a8c3e33328ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b64d7414447efb8895d9bef92bbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:23Z,use_quota=True,user_id='df369db8be8d43a4946057376957d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef393115-6521-46de-9735-1376b84efd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef393115-6521-46de-9735-1376b84efd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb87b141-5d24-4dbd-a06e-0cc2a1f5a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb87b141-5d24-4dbd-a06e-0cc2a1f5a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8008420f-8abf-4557-86c5-a8c3e33328ea', 'volume_name': 'volume-8008420f-8abf-4557-86c5-a8c3e33328ea', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d49ad6-eaf9-457f-bab9-7c91a19682cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d49ad6-eaf9-457f-bab9-7c91a19682cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcec1c3-ac5b-46b5-9667-bfba9aeba73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:22 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume 8008420f-8abf-4557-86c5-a8c3e33328ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8008420f-8abf-4557-86c5-a8c3e33328ea', 'volume_size': 1} Apr 24 15:30:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:23 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1073741824" returned: 0 in 0.959s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:23 devstack sudo[84292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:23 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "cinder-d18fc986-727e-4658-9163-d1b4253fd887-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "cinder-d18fc986-727e-4658-9163-d1b4253fd887-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "cinder-quobyte-d18fc986-727e-4658-9163-d1b4253fd887" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "cinder-quobyte-d18fc986-727e-4658-9163-d1b4253fd887" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacad59d-c355-48c8-b48c-ec5486333fa8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:23 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 Apr 24 15:30:23 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:23 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 0.677s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2012383980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008420f-8abf-4557-86c5-a8c3e33328ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b64d7414447efb8895d9bef92bbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:23Z,use_quota=True,user_id='df369db8be8d43a4946057376957d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Creating volume 8008420f-8abf-4557-86c5-a8c3e33328ea {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:24 devstack sudo[84313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea 1073741824 Apr 24 15:30:24 devstack sudo[84313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Attempting download of 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d2e729-b00c-4d64-918f-a38049b4b20c]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:24 devstack sudo[84315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid Apr 24 15:30:24 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:24 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887" returned: 0 in 0.944s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:24 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887 Apr 24 15:30:24 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:24 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid" returned: 0 in 0.736s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:25 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid Apr 24 15:30:25 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:25 devstack sudo[84313]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea 1073741824" returned: 0 in 1.105s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:25 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea Apr 24 15:30:25 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:25 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d18fc986-727e-4658-9163-d1b4253fd887" returned: 0 in 0.774s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "cinder-quobyte-d18fc986-727e-4658-9163-d1b4253fd887" released by "delete_volume" :: held 1.802s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Created reservations ['67e5f716-97ea-48f0-ba4a-3d341f888c73', '0da80c1c-72ef-4d31-8771-0b419a0a5c84', '7ef87f6b-4221-4abe-9a5f-0f077ee8d02e', '73e4d03b-ce7e-4a6c-a5c4-e8884f411629'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:25 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid" returned: 1 in 0.666s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_rnnu3sid' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dccdc7-e5f0-424e-8c01-b807cd404e6f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:25 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:25 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:25 devstack sudo[84336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD Apr 24 15:30:25 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:26 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea" returned: 0 in 0.917s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcec1c3-ac5b-46b5-9667-bfba9aeba73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8008420f-8abf-4557-86c5-a8c3e33328ea', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc08d4bd-34d8-4d7d-8746-aa8e17adf2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume volume-8008420f-8abf-4557-86c5-a8c3e33328ea (8008420f-8abf-4557-86c5-a8c3e33328ea): created successfully Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc08d4bd-34d8-4d7d-8746-aa8e17adf2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Flow 'volume_create_manager' (56081f2d-0c97-46e7-b161-c169c41316ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2bd172e4-3dd0-4a2e-9a1d-8812656e4ace tempest-VolumeQuotasAdminTestJSON-1348470936 None] Created volume successfully. Apr 24 15:30:26 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] 35d86ae8-c267-4804-98fd-3c88f2d8852d was qcow2, converting to raw {{(pid=81909) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:26 devstack sudo[84345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:26 devstack sudo[84345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:26 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.158s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Deleted volume successfully. Apr 24 15:30:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c7cdf614-4f4f-4080-aa7b-2b4b4091ac82 tempest-DeleteServersTestJSON-608989456 None] Lock "cinder-d18fc986-727e-4658-9163-d1b4253fd887-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "cinder-8008420f-8abf-4557-86c5-a8c3e33328ea-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "cinder-8008420f-8abf-4557-86c5-a8c3e33328ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "cinder-quobyte-8008420f-8abf-4557-86c5-a8c3e33328ea" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "cinder-quobyte-8008420f-8abf-4557-86c5-a8c3e33328ea" acquired by "delete_volume" :: waited 0.036s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84c740-96f1-4c4a-b616-ae5e188ac859]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:27 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea Apr 24 15:30:27 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (c9cd9974-fa84-4fc7-8a04-e1e26b88604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76df5160-1c1a-4b50-9675-5a5d7d975d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76df5160-1c1a-4b50-9675-5a5d7d975d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678578385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd72c0c-a87d-4d35-b230-375661c3fd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:28Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8881f25-514c-43ef-9547-8cf013c4a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8881f25-514c-43ef-9547-8cf013c4a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3c7e9e-f7b0-4918-8631-5e1c20e9f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3c7e9e-f7b0-4918-8631-5e1c20e9f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd72c0c-a87d-4d35-b230-375661c3fd07', 'volume_name': 'volume-5dd72c0c-a87d-4d35-b230-375661c3fd07', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490f81ea-8da8-456d-a293-793f51fbe5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490f81ea-8da8-456d-a293-793f51fbe5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef151d38-dad5-4057-b101-690a851ebc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:27 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Volume 5dd72c0c-a87d-4d35-b230-375661c3fd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd72c0c-a87d-4d35-b230-375661c3fd07', 'volume_size': 1} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678578385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd72c0c-a87d-4d35-b230-375661c3fd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:28Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Creating volume 5dd72c0c-a87d-4d35-b230-375661c3fd07 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:27 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:28 devstack sudo[84357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 1073741824 Apr 24 15:30:28 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:28 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea" returned: 0 in 1.027s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:28 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea Apr 24 15:30:28 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:28 devstack sudo[84345]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 2.198s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:28 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_4bq24yqkdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:30:28 devstack cinder-volume[81909]: INFO cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Converted 112.00 MB image at 50.91 MB/s Apr 24 15:30:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:28 devstack sudo[84373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1G Apr 24 15:30:28 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:29 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 1073741824" returned: 0 in 1.300s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:29 devstack sudo[84389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 Apr 24 15:30:29 devstack sudo[84389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:29 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8008420f-8abf-4557-86c5-a8c3e33328ea" returned: 0 in 1.059s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "cinder-quobyte-8008420f-8abf-4557-86c5-a8c3e33328ea" released by "delete_volume" :: held 2.189s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Created reservations ['3c2b0339-2c6d-46f3-a365-aa028be8a063', 'b29b4437-6b31-43af-bbb4-5c935751ae60', '787682f7-7eae-459f-897f-63beabc6ca9b', 'eab94a97-e98a-4335-8372-9081d3cda1e0'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:29 devstack sudo[84401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:29 devstack sudo[84401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:30 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c 1G" returned: 0 in 1.316s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f273b2-275f-47b6-ac4b-55b0d8e06a1b]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:30 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:30 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:30 devstack sudo[84389]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07" returned: 0 in 1.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.951s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef151d38-dad5-4057-b101-690a851ebc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd72c0c-a87d-4d35-b230-375661c3fd07', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4b1c1f-80ae-4fb1-8550-79ee640d5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Volume volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 (5dd72c0c-a87d-4d35-b230-375661c3fd07): created successfully Apr 24 15:30:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4b1c1f-80ae-4fb1-8550-79ee640d5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (c9cd9974-fa84-4fc7-8a04-e1e26b88604d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-00404047-dfea-49e5-abb3-66dd13d6039c tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:30:31 devstack sudo[84401]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.432s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Deleted volume successfully. Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a7354ec1-53b3-4f51-bd6a-1cf1e461e72f tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "cinder-8008420f-8abf-4557-86c5-a8c3e33328ea-delete_volume" released by "delete_volume" :: held 4.140s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bdcfa982-d95f-490e-ab1f-c8b533503bd1 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07" by "attach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bdcfa982-d95f-490e-ab1f-c8b533503bd1 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07" acquired by "attach_volume" :: waited 0.052s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:31 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 1.320s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bdcfa982-d95f-490e-ab1f-c8b533503bd1 tempest-VolumesActionsTest-1440308896 None] Attaching volume 5dd72c0c-a87d-4d35-b230-375661c3fd07 to instance 55c96b3a-1786-44ca-bf44-1fcd22a26ee1 at mountpoint /dev/vdb on host None. Apr 24 15:30:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bdcfa982-d95f-490e-ab1f-c8b533503bd1 tempest-VolumesActionsTest-1440308896 None] Attach volume completed successfully. Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bdcfa982-d95f-490e-ab1f-c8b533503bd1 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07" released by "attach_volume" :: held 0.157s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:31 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:31 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Flow 'volume_create_manager' (706a2231-6e0d-4358-a8da-9117a5838dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc205b5c-373f-44a0-9744-762e101e1fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc205b5c-373f-44a0-9744-762e101e1fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1450494231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0f46bf-d1e5-4a70-8520-81eb286babb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b64d7414447efb8895d9bef92bbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:32Z,use_quota=True,user_id='df369db8be8d43a4946057376957d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b969e6c7-f62a-4054-af1f-366477b63a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b969e6c7-f62a-4054-af1f-366477b63a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0e0141-58a6-4e65-a419-d0401f1c9150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0e0141-58a6-4e65-a419-d0401f1c9150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0f46bf-d1e5-4a70-8520-81eb286babb2', 'volume_name': 'volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4858d902-0579-4909-a108-4dc5c308e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4858d902-0579-4909-a108-4dc5c308e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d3db80-00da-413e-9005-3e58a20cef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume ee0f46bf-d1e5-4a70-8520-81eb286babb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2', 'volume_size': 1} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1450494231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0f46bf-d1e5-4a70-8520-81eb286babb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b64d7414447efb8895d9bef92bbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:32Z,use_quota=True,user_id='df369db8be8d43a4946057376957d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Creating volume ee0f46bf-d1e5-4a70-8520-81eb286babb2 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:32 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:32 devstack sudo[84415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 1073741824 Apr 24 15:30:32 devstack sudo[84415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:32 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 1 in 1.331s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Downloaded image 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c successfully. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d for user a4ad50da488340efb67781750fb2bd85 is deleted. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Marking volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c as bootable. {{(pid=81909) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Copying metadata from image 35d86ae8-c267-4804-98fd-3c88f2d8852d to 5b4767e8-e575-4325-a0bd-03ca69b8d24c. {{(pid=81909) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 15:30:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Creating volume glance metadata for volume 5b4767e8-e575-4325-a0bd-03ca69b8d24c backed by image 35d86ae8-c267-4804-98fd-3c88f2d8852d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81909) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822c3332-3b39-4d16-bfd5-ce819a21ea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4539f0-3709-4b98-bc14-8f82f66eece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Volume volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c (5b4767e8-e575-4325-a0bd-03ca69b8d24c): created successfully Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4539f0-3709-4b98-bc14-8f82f66eece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Flow 'volume_create_manager' (971c66cf-9bd0-46f7-96cb-833ed17cf122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Terminate volume connection completed successfully. Apr 24 15:30:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-a1ea2763-acf9-4a1d-a0eb-8db6b9d6a438 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Created volume successfully. Apr 24 15:30:33 devstack sudo[84415]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 1073741824" returned: 0 in 1.427s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:33 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 Apr 24 15:30:33 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" by "detach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Detaching volume 5dd72c0c-a87d-4d35-b230-375661c3fd07 from instance 55c96b3a-1786-44ca-bf44-1fcd22a26ee1. Apr 24 15:30:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Detach volume completed successfully. Apr 24 15:30:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-35a2a922-65d3-4d80-a836-093764480e58 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:34 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2" returned: 0 in 0.600s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d3db80-00da-413e-9005-3e58a20cef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3105e1-c52e-4e8f-aa6e-fbf4152a04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:34 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Volume volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 (ee0f46bf-d1e5-4a70-8520-81eb286babb2): created successfully Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3105e1-c52e-4e8f-aa6e-fbf4152a04a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Flow 'volume_create_manager' (706a2231-6e0d-4358-a8da-9117a5838dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fc9de583-605a-4e93-a18a-28c6d1649d4e tempest-VolumeQuotasAdminTestJSON-1348470936 None] Created volume successfully. Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a665bce1-c16c-4844-8a5a-737d92a38b4e tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" by "detach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a665bce1-c16c-4844-8a5a-737d92a38b4e tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a665bce1-c16c-4844-8a5a-737d92a38b4e tempest-VolumesActionsTest-1440308896 None] Volume detach called, but volume not attached. Apr 24 15:30:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a665bce1-c16c-4844-8a5a-737d92a38b4e tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-quobyte-5dd72c0c-a87d-4d35-b230-375661c3fd07" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "cinder-quobyte-5dd72c0c-a87d-4d35-b230-375661c3fd07" acquired by "delete_volume" :: waited 0.036s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d1796-8dbb-440b-ad17-15f6ee8b8545]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:35 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 Apr 24 15:30:35 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d449b0-5d4c-4cda-8714-6f0edcc4b98c]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:36 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:36 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:36 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07" returned: 0 in 1.087s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:36 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07 Apr 24 15:30:36 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0f149568-c818-474c-989c-bb703e9e02df tempest-VolumeQuotasAdminTestJSON-794274251 None] Transfer volume completed successfully. Apr 24 15:30:36 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5dd72c0c-a87d-4d35-b230-375661c3fd07" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:36 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "cinder-quobyte-5dd72c0c-a87d-4d35-b230-375661c3fd07" released by "delete_volume" :: held 1.758s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Created reservations ['05e0d262-995d-4071-a633-b2069ebbfd53', '73a15fdb-812a-468a-84e5-0cc0563490b5', '78e0d5ee-b4f2-49a3-9756-d7ffa11abdeb', 'c0869686-9475-4115-af4c-84db27c0354c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:37 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 1.043s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:37 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:30:37 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:37 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:37 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Acquiring lock "cinder-ee0f46bf-d1e5-4a70-8520-81eb286babb2-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "cinder-ee0f46bf-d1e5-4a70-8520-81eb286babb2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Acquiring lock "cinder-quobyte-ee0f46bf-d1e5-4a70-8520-81eb286babb2" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "cinder-quobyte-ee0f46bf-d1e5-4a70-8520-81eb286babb2" acquired by "delete_volume" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da8cb5-d6ba-4de0-8785-d6a753a49f88]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:37 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 1 in 0.891s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:30:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.990s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:37 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 Apr 24 15:30:37 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e', 'name': 'volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '622becf1-a143-4abd-a5b9-7f6f7806f88c', 'enforce_multipath': True} {{(pid=81909) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 15:30:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-53c537ca-fa28-4df5-b62e-54bbd97074fb req-62a67861-c650-4886-9dc5-bc0825df4cdc tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] attachment_update completed successfully. Apr 24 15:30:38 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.916s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Deleted volume successfully. Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-040b719f-a11a-4d97-9871-4a989054d25a tempest-VolumesActionsTest-1440308896 None] Lock "cinder-5dd72c0c-a87d-4d35-b230-375661c3fd07-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:38 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2" returned: 0 in 0.618s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:38 devstack sudo[84499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2 Apr 24 15:30:38 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:39 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ee0f46bf-d1e5-4a70-8520-81eb286babb2" returned: 0 in 0.738s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "cinder-quobyte-ee0f46bf-d1e5-4a70-8520-81eb286babb2" released by "delete_volume" :: held 1.436s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Created reservations ['5605ae46-89a1-4bd9-a814-21ce8e387bdf', '9a09b6a7-e7cd-4091-b2ee-b2276e447494', 'ab4bc7b0-ca78-47ca-b1ec-062bb9bfc1c2', '9f475d35-8c85-4c6d-ae17-11ddb8e6cadd'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:39 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:39 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:40 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:40 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:40 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Deleted volume successfully. Apr 24 15:30:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-873a60e4-0114-4107-9723-680cfb913b6d tempest-VolumeQuotasAdminTestJSON-2045316229 None] Lock "cinder-ee0f46bf-d1e5-4a70-8520-81eb286babb2-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (cffa7513-dd1d-48ce-9070-722e69b0fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffcbde-afc7-4f0f-9648-5540173c89c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffcbde-afc7-4f0f-9648-5540173c89c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-290744941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8dd294-8050-4340-9d45-4dd8cabc109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:47Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e129d35f-d0b4-40e0-91d1-cedb2ae25cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e129d35f-d0b4-40e0-91d1-cedb2ae25cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb77191-4bd0-4406-8070-838bc25ada83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb77191-4bd0-4406-8070-838bc25ada83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8dd294-8050-4340-9d45-4dd8cabc109b', 'volume_name': 'volume-5d8dd294-8050-4340-9d45-4dd8cabc109b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb94470-022a-4a0a-8699-8af805423984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb94470-022a-4a0a-8699-8af805423984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbfe8a2-4f0d-46a4-a2f3-4dbee615d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:47 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Volume 5d8dd294-8050-4340-9d45-4dd8cabc109b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8dd294-8050-4340-9d45-4dd8cabc109b', 'volume_size': 1} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-290744941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8dd294-8050-4340-9d45-4dd8cabc109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:47Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Creating volume 5d8dd294-8050-4340-9d45-4dd8cabc109b {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:47 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:47 devstack sudo[84584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b 1073741824 Apr 24 15:30:47 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:49 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:49 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:49 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b 1073741824" returned: 0 in 1.871s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:49 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b Apr 24 15:30:49 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:50 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.486s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:50 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b" returned: 0 in 1.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (3515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.521s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbfe8a2-4f0d-46a4-a2f3-4dbee615d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8dd294-8050-4340-9d45-4dd8cabc109b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80fec3-292f-4109-a42e-df9c545823ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:50 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Volume volume-5d8dd294-8050-4340-9d45-4dd8cabc109b (5d8dd294-8050-4340-9d45-4dd8cabc109b): created successfully Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80fec3-292f-4109-a42e-df9c545823ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (cffa7513-dd1d-48ce-9070-722e69b0fb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-05859f73-8066-409b-be2c-335fc605a888 tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:30:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-5d8dd294-8050-4340-9d45-4dd8cabc109b-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-5d8dd294-8050-4340-9d45-4dd8cabc109b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-quobyte-5d8dd294-8050-4340-9d45-4dd8cabc109b" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-5d8dd294-8050-4340-9d45-4dd8cabc109b" acquired by "delete_volume" :: waited 0.031s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2154b2c-f40a-46ca-934b-1e2c7a185d9d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:52 devstack sudo[84637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b Apr 24 15:30:52 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:52 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Flow 'volume_create_manager' (8021124d-8341-485e-97d3-f6ebb9aa2b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e44e3-7242-49cf-973e-b44d3cf80759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e44e3-7242-49cf-973e-b44d3cf80759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1747112421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51f1381-c7aa-484d-8b70-3913961b7389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea6f22ede154643bf678b0e2bf1b456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:53Z,use_quota=True,user_id='836db087497c412e8c5dd440a2d11e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65309b0c-ed02-4082-89b1-8739152b1f64),volume_type_id=65309b0c-ed02-4082-89b1-8739152b1f64)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e07e8e3-bc53-496d-85f6-ebf4e7df6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e07e8e3-bc53-496d-85f6-ebf4e7df6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7646e3-d9c8-4f37-9c41-72a6353cfca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7646e3-d9c8-4f37-9c41-72a6353cfca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51f1381-c7aa-484d-8b70-3913961b7389', 'volume_name': 'volume-a51f1381-c7aa-484d-8b70-3913961b7389', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cbf516-479b-42a6-a1fb-4200a91baff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cbf516-479b-42a6-a1fb-4200a91baff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93cd523-8a45-4dda-958c-7ef01653e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:53 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Volume a51f1381-c7aa-484d-8b70-3913961b7389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51f1381-c7aa-484d-8b70-3913961b7389', 'volume_size': 1} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1747112421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51f1381-c7aa-484d-8b70-3913961b7389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea6f22ede154643bf678b0e2bf1b456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:53Z,use_quota=True,user_id='836db087497c412e8c5dd440a2d11e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65309b0c-ed02-4082-89b1-8739152b1f64),volume_type_id=65309b0c-ed02-4082-89b1-8739152b1f64)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Creating volume a51f1381-c7aa-484d-8b70-3913961b7389 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:53 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:53 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 1073741824 Apr 24 15:30:53 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:53 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b" returned: 0 in 1.349s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:53 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b Apr 24 15:30:53 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:54 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5d8dd294-8050-4340-9d45-4dd8cabc109b" returned: 0 in 0.759s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-5d8dd294-8050-4340-9d45-4dd8cabc109b" released by "delete_volume" :: held 2.186s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:54 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Created reservations ['1b928f7b-75a8-46fc-9dc1-528dcd4195ee', 'd9ae589b-82ac-4cb6-bb65-f7b1db41e7f0', 'e9bbd75a-a8c9-40a9-9a0b-ddd3e5824b6d', 'd674ae66-4e5f-4b7b-9b36-30954847413a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 1073741824" returned: 0 in 1.110s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:54 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 Apr 24 15:30:54 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:54 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:54 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:54 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389" returned: 0 in 0.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93cd523-8a45-4dda-958c-7ef01653e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51f1381-c7aa-484d-8b70-3913961b7389', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d6d74a-1fdd-4dfa-a677-7b824333a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:54 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:54 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Volume volume-a51f1381-c7aa-484d-8b70-3913961b7389 (a51f1381-c7aa-484d-8b70-3913961b7389): created successfully Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d6d74a-1fdd-4dfa-a677-7b824333a208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Flow 'volume_create_manager' (8021124d-8341-485e-97d3-f6ebb9aa2b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Deleted volume successfully. Apr 24 15:30:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-20e1f92c-183f-43e4-bebe-4d7af6f1b07d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Created volume successfully. Apr 24 15:30:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76321448-3183-4ffb-91fb-49d5db73e161 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-5d8dd294-8050-4340-9d45-4dd8cabc109b-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:55 devstack sudo[84693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:55 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (4c454b02-5a41-4961-b122-7fc91da66ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d4277a-4846-4237-9dd4-c64614868941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d4277a-4846-4237-9dd4-c64614868941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733945287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bca733-8f99-4ce2-8b93-cc4216f463a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:56Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07b0d7-d9f2-464f-a780-d669e81c905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07b0d7-d9f2-464f-a780-d669e81c905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bed82f-5a6e-47f6-907b-707943d2e67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bed82f-5a6e-47f6-907b-707943d2e67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bca733-8f99-4ce2-8b93-cc4216f463a0', 'volume_name': 'volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059a6b8b-012a-4ba8-b9eb-2574bc9730e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059a6b8b-012a-4ba8-b9eb-2574bc9730e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44df2f67-9639-4704-a4ad-8c3577e13562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:55 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Volume d7bca733-8f99-4ce2-8b93-cc4216f463a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0', 'volume_size': 1} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733945287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bca733-8f99-4ce2-8b93-cc4216f463a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:30:56Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Creating volume d7bca733-8f99-4ce2-8b93-cc4216f463a0 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:30:55 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:30:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:56 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 1073741824 Apr 24 15:30:56 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:56 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.607s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:56 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-171813dc-5605-4819-990b-bf7ed8c9480d tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Retype volume completed successfully. Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "cinder-a51f1381-c7aa-484d-8b70-3913961b7389-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "cinder-a51f1381-c7aa-484d-8b70-3913961b7389-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "cinder-quobyte-a51f1381-c7aa-484d-8b70-3913961b7389" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "cinder-quobyte-a51f1381-c7aa-484d-8b70-3913961b7389" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92404ad-e61a-416b-9216-c15dc90e691e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:56 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 1073741824" returned: 0 in 0.913s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:57 devstack sudo[84720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 Apr 24 15:30:57 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:57 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 Apr 24 15:30:57 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:57 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0" returned: 0 in 0.636s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44df2f67-9639-4704-a4ad-8c3577e13562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23be7fc5-3db8-420d-b0ae-89d60b3689cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:30:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Volume volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 (d7bca733-8f99-4ce2-8b93-cc4216f463a0): created successfully Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23be7fc5-3db8-420d-b0ae-89d60b3689cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (4c454b02-5a41-4961-b122-7fc91da66ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:30:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c7814380-dada-4ed7-8b97-d130e0562bef tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:30:57 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389" returned: 0 in 0.802s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:57 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389 Apr 24 15:30:57 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:58 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a51f1381-c7aa-484d-8b70-3913961b7389" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "cinder-quobyte-a51f1381-c7aa-484d-8b70-3913961b7389" released by "delete_volume" :: held 1.451s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:58 devstack cinder-volume[81909]: WARNING cinder.quota [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:30:58 devstack cinder-volume[81909]: WARNING cinder.quota [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Created reservations ['dff6b477-9b73-41bd-854a-8ad9feb136dd', '8acb3155-1ee2-4527-a542-b116663ebefb', 'f3740ac4-c1ef-40ed-baf8-64e56ff96843', 'f1f06fa5-3c0e-4254-b4ce-a8d75956b1bd'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-d7bca733-8f99-4ce2-8b93-cc4216f463a0-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-d7bca733-8f99-4ce2-8b93-cc4216f463a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-quobyte-d7bca733-8f99-4ce2-8b93-cc4216f463a0" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-d7bca733-8f99-4ce2-8b93-cc4216f463a0" acquired by "delete_volume" :: waited 0.048s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:30:58 devstack sudo[84734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:30:58 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c58013-38ff-480e-ba38-fccaf714a6f2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:30:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:58 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 Apr 24 15:30:58 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:30:59 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.689s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:59 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:30:59 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Deleted volume successfully. Apr 24 15:30:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b31786d3-ad3d-4141-a131-fe4315ef5e46 tempest-VolumeRetypeWithoutMigrationTest-1882279186 None] Lock "cinder-a51f1381-c7aa-484d-8b70-3913961b7389-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:30:59 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 24 15:30:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0" returned: 0 in 1.087s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:30:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:30:59 devstack sudo[84757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0 Apr 24 15:30:59 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:00 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d7bca733-8f99-4ce2-8b93-cc4216f463a0" returned: 0 in 0.642s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-d7bca733-8f99-4ce2-8b93-cc4216f463a0" released by "delete_volume" :: held 1.787s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Created reservations ['2964b00d-1d77-4068-82d2-4dcea502f045', '1028dff4-e782-4021-8af0-0644dfd47906', '868a7a8c-f91a-41da-8178-fed798822d66', 'f7caa1ee-c47f-4ec4-8f9f-a1df0d6893ba'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:00 devstack sudo[84760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:00 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:01 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (028eb656-5e20-4934-bcc5-740d01eed760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399010cb-b5bf-4f2b-8cc9-bb93ed91c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.890s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:01 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Deleted volume successfully. Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399010cb-b5bf-4f2b-8cc9-bb93ed91c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559775046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c78ed8-564b-4565-98db-d21eb55e762c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:01Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc2410c-226e-437a-94fb-a056ffe9e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc2410c-226e-437a-94fb-a056ffe9e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57869efa-f0b3-4782-9aba-bd88f2490f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57869efa-f0b3-4782-9aba-bd88f2490f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c78ed8-564b-4565-98db-d21eb55e762c', 'volume_name': 'volume-20c78ed8-564b-4565-98db-d21eb55e762c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4687e6-9d8c-4950-9ae0-23a9b5081691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4687e6-9d8c-4950-9ae0-23a9b5081691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb16e24e-4646-4533-983e-c9361d340a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:01 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Volume 20c78ed8-564b-4565-98db-d21eb55e762c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c78ed8-564b-4565-98db-d21eb55e762c', 'volume_size': 1} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559775046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c78ed8-564b-4565-98db-d21eb55e762c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:01Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Creating volume 20c78ed8-564b-4565-98db-d21eb55e762c {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:01 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3db84d40-f249-4c63-ba52-1601bab8cd59 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-d7bca733-8f99-4ce2-8b93-cc4216f463a0-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:01 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c 1073741824 Apr 24 15:31:01 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:02 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c 1073741824" returned: 0 in 1.106s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:02 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c Apr 24 15:31:02 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:03 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c" returned: 0 in 0.859s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb16e24e-4646-4533-983e-c9361d340a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c78ed8-564b-4565-98db-d21eb55e762c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be03cab-9c66-4ddb-8539-e0477d1d0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:03 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Volume volume-20c78ed8-564b-4565-98db-d21eb55e762c (20c78ed8-564b-4565-98db-d21eb55e762c): created successfully Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be03cab-9c66-4ddb-8539-e0477d1d0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (028eb656-5e20-4934-bcc5-740d01eed760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:03 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1f4d5e08-5c65-4ce0-bdcb-57c9381f84ee tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:31:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-20c78ed8-564b-4565-98db-d21eb55e762c-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-20c78ed8-564b-4565-98db-d21eb55e762c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-quobyte-20c78ed8-564b-4565-98db-d21eb55e762c" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-20c78ed8-564b-4565-98db-d21eb55e762c" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fef153-077b-4ae9-87ac-121efa61bf22]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:05 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c Apr 24 15:31:05 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:05 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c" returned: 0 in 0.849s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:05 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c Apr 24 15:31:05 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:06 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-20c78ed8-564b-4565-98db-d21eb55e762c" returned: 0 in 0.635s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-20c78ed8-564b-4565-98db-d21eb55e762c" released by "delete_volume" :: held 1.539s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Created reservations ['750c884d-1c9a-4511-a167-91788a9853f9', '69b64414-b919-4d44-a433-f1c4d0d15dbc', 'c1e2b841-1835-4088-a7d5-1d97256c465e', '675828ae-9f2b-429d-bbc3-15ca3863a056'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:06 devstack sudo[84855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:06 devstack sudo[84855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Flow 'volume_create_manager' (9b70f8dc-c661-46b7-8bb5-3a628aaf1aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca09d6e-edc4-455c-bc57-f01456013328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca09d6e-edc4-455c-bc57-f01456013328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1756436193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73731e06-df7d-4316-8108-35ab6ffbd607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cfc05b2cf64db59a028384053c8432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:07Z,use_quota=True,user_id='dee68650226c418fbfd9760531ad3253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8233cd30-c9f0-4b8c-899b-389c3e398d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8233cd30-c9f0-4b8c-899b-389c3e398d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f0635a-538a-4d7d-a895-dc9195a82342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f0635a-538a-4d7d-a895-dc9195a82342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73731e06-df7d-4316-8108-35ab6ffbd607', 'volume_name': 'volume-73731e06-df7d-4316-8108-35ab6ffbd607', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa609a-217e-4904-a505-47037573238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa609a-217e-4904-a505-47037573238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f789b0e6-21cb-45ca-ae69-1e7f4639662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:07 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Volume 73731e06-df7d-4316-8108-35ab6ffbd607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73731e06-df7d-4316-8108-35ab6ffbd607', 'volume_size': 1} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1756436193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73731e06-df7d-4316-8108-35ab6ffbd607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cfc05b2cf64db59a028384053c8432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:07Z,use_quota=True,user_id='dee68650226c418fbfd9760531ad3253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Creating volume 73731e06-df7d-4316-8108-35ab6ffbd607 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:07 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:07 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 1073741824 Apr 24 15:31:07 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:07 devstack sudo[84855]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.913s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Deleted volume successfully. Apr 24 15:31:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9401a280-db03-48e5-865e-74452368a175 tempest-VolumesActionsTest-1667054291 None] Lock "cinder-20c78ed8-564b-4565-98db-d21eb55e762c-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (75624510-e198-4dcf-a296-9aac67f68982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb090dc-6fa1-4b95-afa1-fd88da7d3128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb090dc-6fa1-4b95-afa1-fd88da7d3128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-62788048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd949e0-dfb9-4918-9d32-308ebded367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:08Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aa22e7-0e39-43ef-a5c4-4129e5c84e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aa22e7-0e39-43ef-a5c4-4129e5c84e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0362088a-6698-4d5f-901e-233caf6bce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0362088a-6698-4d5f-901e-233caf6bce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd949e0-dfb9-4918-9d32-308ebded367d', 'volume_name': 'volume-2bd949e0-dfb9-4918-9d32-308ebded367d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e8efed-0935-4527-8384-e8f2666c5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e8efed-0935-4527-8384-e8f2666c5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c767c-67d6-4f5a-a407-7b143a809cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Volume 2bd949e0-dfb9-4918-9d32-308ebded367d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd949e0-dfb9-4918-9d32-308ebded367d', 'volume_size': 1} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:08 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 1073741824" returned: 0 in 1.210s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:08 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 Apr 24 15:31:08 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:09 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-62788048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd949e0-dfb9-4918-9d32-308ebded367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:08Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Creating volume 2bd949e0-dfb9-4918-9d32-308ebded367d {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:09 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f789b0e6-21cb-45ca-ae69-1e7f4639662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73731e06-df7d-4316-8108-35ab6ffbd607', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789c82e7-dff1-47cd-9a8d-9e0be8375af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:09 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d 1073741824 Apr 24 15:31:09 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Volume volume-73731e06-df7d-4316-8108-35ab6ffbd607 (73731e06-df7d-4316-8108-35ab6ffbd607): created successfully Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789c82e7-dff1-47cd-9a8d-9e0be8375af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Flow 'volume_create_manager' (9b70f8dc-c661-46b7-8bb5-3a628aaf1aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-247d363f-c956-4b4a-9e11-fb20c8ef637a tempest-VolumesServicesTestJSON-1205488413 None] Created volume successfully. Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Acquiring lock "cinder-73731e06-df7d-4316-8108-35ab6ffbd607-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "cinder-73731e06-df7d-4316-8108-35ab6ffbd607-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Acquiring lock "cinder-quobyte-73731e06-df7d-4316-8108-35ab6ffbd607" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "cinder-quobyte-73731e06-df7d-4316-8108-35ab6ffbd607" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[40484c0b-a950-4573-81fb-649781643752]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:09 devstack sudo[84945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 Apr 24 15:31:09 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:10 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d 1073741824" returned: 0 in 0.837s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:10 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d Apr 24 15:31:10 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:10 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607" returned: 0 in 0.941s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:10 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607 Apr 24 15:31:10 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:11 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d" returned: 0 in 0.816s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c767c-67d6-4f5a-a407-7b143a809cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd949e0-dfb9-4918-9d32-308ebded367d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1365076-066f-4a14-a969-bbe9543800eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:11 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Volume volume-2bd949e0-dfb9-4918-9d32-308ebded367d (2bd949e0-dfb9-4918-9d32-308ebded367d): created successfully Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1365076-066f-4a14-a969-bbe9543800eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (75624510-e198-4dcf-a296-9aac67f68982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cf58fce3-df8b-4aac-b96d-8cc50579e691 tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:31:11 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-73731e06-df7d-4316-8108-35ab6ffbd607" returned: 0 in 0.656s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-2bd949e0-dfb9-4918-9d32-308ebded367d-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "cinder-quobyte-73731e06-df7d-4316-8108-35ab6ffbd607" released by "delete_volume" :: held 1.680s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "cinder-2bd949e0-dfb9-4918-9d32-308ebded367d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Acquiring lock "cinder-quobyte-2bd949e0-dfb9-4918-9d32-308ebded367d" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-2bd949e0-dfb9-4918-9d32-308ebded367d" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd79ea7-e358-4c9a-b87d-64c76226c3ff]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Created reservations ['983b235d-8526-444b-8375-e48a2c40039f', 'fd1e1a9d-8dfa-4aa7-abe5-2487ac1a3df2', '02a6c1cb-40f1-4dda-ba54-fef7233720f6', '73758b92-ee9c-4e22-bfc6-382c905797ca'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:11 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d Apr 24 15:31:11 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:11 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:11 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:12 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d" returned: 0 in 0.758s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:12 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d Apr 24 15:31:12 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:12 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.728s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:12 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:12 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Deleted volume successfully. Apr 24 15:31:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0cb7a956-51cc-466f-97c0-c5339f33084a tempest-VolumesServicesTestJSON-1205488413 None] Lock "cinder-73731e06-df7d-4316-8108-35ab6ffbd607-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:13 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2bd949e0-dfb9-4918-9d32-308ebded367d" returned: 0 in 1.168s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "cinder-quobyte-2bd949e0-dfb9-4918-9d32-308ebded367d" released by "delete_volume" :: held 2.017s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:13 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Created reservations ['2bdd5b2f-9626-41ea-9a94-2351a4ab0e85', '8cea6770-969c-4b74-81ca-f9ca6e8e97ff', 'e97cd043-9f86-4d90-b592-67dcc4fde036', '01733783-1f8a-46f5-a201-24a593ce5022'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:14 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:14 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (b2b53718-5cdb-4cf2-9611-7246addaaf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52315640-9c0f-4adb-aee7-52dd7aedea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52315640-9c0f-4adb-aee7-52dd7aedea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890121768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db74a80-db93-4454-b013-210273d094f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:16Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9b3dfb-5a7c-4045-b60c-4f53fd91dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9b3dfb-5a7c-4045-b60c-4f53fd91dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb386fcc-e39a-4b57-adb8-ba956584cba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb386fcc-e39a-4b57-adb8-ba956584cba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db74a80-db93-4454-b013-210273d094f1', 'volume_name': 'volume-1db74a80-db93-4454-b013-210273d094f1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448eb5ed-bf2d-499a-8862-0f2ccbf68ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448eb5ed-bf2d-499a-8862-0f2ccbf68ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08229401-f1af-4db0-8615-c767e50ac7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:15 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Volume 1db74a80-db93-4454-b013-210273d094f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db74a80-db93-4454-b013-210273d094f1', 'volume_size': 1} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890121768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db74a80-db93-4454-b013-210273d094f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849c2d10271d40a9b65ac5be8d23dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:16Z,use_quota=True,user_id='4eb8e89d6bdf4059a99ce2ca861c1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Creating volume 1db74a80-db93-4454-b013-210273d094f1 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:15 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:16 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 1073741824 Apr 24 15:31:16 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:16 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 2.259s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:16 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Deleted volume successfully. Apr 24 15:31:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cc021bfd-5d8b-437d-a01b-fbb748430a5e tempest-VolumesActionsTest-1667054291 None] Lock "cinder-2bd949e0-dfb9-4918-9d32-308ebded367d-delete_volume" released by "delete_volume" :: held 5.043s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:18 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 1073741824" returned: 0 in 2.459s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:18 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 Apr 24 15:31:18 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:20 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1" returned: 0 in 1.896s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] <== create_volume: return (4514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.520s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=103,cinder:UPDATE=124,cinder:INSERT=26,cinder:DELETE=8 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08229401-f1af-4db0-8615-c767e50ac7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db74a80-db93-4454-b013-210273d094f1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4619ac8c-2ce7-4ec3-a33a-02c6d307eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=99,cinder:UPDATE=123,cinder:INSERT=40,cinder:DELETE=12 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:31:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Volume volume-1db74a80-db93-4454-b013-210273d094f1 (1db74a80-db93-4454-b013-210273d094f1): created successfully Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4619ac8c-2ce7-4ec3-a33a-02c6d307eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Flow 'volume_create_manager' (b2b53718-5cdb-4cf2-9611-7246addaaf9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2f5f1337-20cd-4a09-b8ca-4cf072768d2b tempest-VolumesActionsTest-1440308896 None] Created volume successfully. Apr 24 15:31:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-66166159-5bdd-4a98-b580-7495ef113ace tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Terminate volume connection completed successfully. Apr 24 15:31:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-66166159-5bdd-4a98-b580-7495ef113ace tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Deleting attachment 622becf1-a143-4abd-a5b9-7f6f7806f88c. {{(pid=81909) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 15:31:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-1db74a80-db93-4454-b013-210273d094f1-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-1db74a80-db93-4454-b013-210273d094f1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "cinder-quobyte-1db74a80-db93-4454-b013-210273d094f1" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-quobyte-1db74a80-db93-4454-b013-210273d094f1" acquired by "delete_volume" :: waited 0.086s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075499e-9bbd-406b-b1ec-1bc0581397eb]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "cinder-5b4767e8-e575-4325-a0bd-03ca69b8d24c-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-5b4767e8-e575-4325-a0bd-03ca69b8d24c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:23 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 Apr 24 15:31:23 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "cinder-quobyte-5b4767e8-e575-4325-a0bd-03ca69b8d24c" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-quobyte-5b4767e8-e575-4325-a0bd-03ca69b8d24c" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d7f278-4b23-4490-b4a8-95b400292452]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:24 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:31:24 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:24 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1" returned: 0 in 1.602s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:24 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1 Apr 24 15:31:24 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:25 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 1.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:25 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:31:25 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:25 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1db74a80-db93-4454-b013-210273d094f1" returned: 0 in 1.051s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-quobyte-1db74a80-db93-4454-b013-210273d094f1" released by "delete_volume" :: held 2.895s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Flow 'volume_create_manager' (9522099c-bd15-4397-866b-c4f9da622a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c77a07-1a8c-401a-b0df-f671a694efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c77a07-1a8c-401a-b0df-f671a694efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1040817183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858442d8-e4ee-4788-b911-acb3a6f36013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386724d0167c453aa5efe72b9f51dfcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:26Z,use_quota=True,user_id='2eaefb8f22484b30922b70aa4d836111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fac3f7-6bd8-47ca-b499-a3881cb11bf0),volume_type_id=99fac3f7-6bd8-47ca-b499-a3881cb11bf0)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115dfa3f-ca4f-4c8e-a0aa-37eb4698cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115dfa3f-ca4f-4c8e-a0aa-37eb4698cd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5425a8b-b225-42f1-bff5-2efd9df7f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5425a8b-b225-42f1-bff5-2efd9df7f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858442d8-e4ee-4788-b911-acb3a6f36013', 'volume_name': 'volume-858442d8-e4ee-4788-b911-acb3a6f36013', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b846c3e-9714-486c-a109-ae0b751e98c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b846c3e-9714-486c-a109-ae0b751e98c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b106ab-ad0a-4024-8251-47cea89be91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Volume 858442d8-e4ee-4788-b911-acb3a6f36013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858442d8-e4ee-4788-b911-acb3a6f36013', 'volume_size': 1} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1040817183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858442d8-e4ee-4788-b911-acb3a6f36013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386724d0167c453aa5efe72b9f51dfcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:26Z,use_quota=True,user_id='2eaefb8f22484b30922b70aa4d836111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fac3f7-6bd8-47ca-b499-a3881cb11bf0),volume_type_id=99fac3f7-6bd8-47ca-b499-a3881cb11bf0)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Creating volume 858442d8-e4ee-4788-b911-acb3a6f36013 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:26 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:26 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 1073741824 Apr 24 15:31:26 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Created reservations ['d18117ff-48a1-49d3-a87a-4a179f22d9e8', 'e1ce3087-644b-4dad-b3be-bdfd4bd9872f', '3654b3c6-1ef2-4d93-80f3-2ae61dc71314', '2a31188a-6d32-41fe-899f-43ddff146032'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:26 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:26 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:26 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 1 in 1.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:31:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:26 devstack sudo[85226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c Apr 24 15:31:26 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:27 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 1073741824" returned: 0 in 1.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:27 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5b4767e8-e575-4325-a0bd-03ca69b8d24c" returned: 0 in 0.828s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-quobyte-5b4767e8-e575-4325-a0bd-03ca69b8d24c" released by "delete_volume" :: held 4.011s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:27 devstack sudo[85233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 Apr 24 15:31:27 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:27 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.368s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:27 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Deleted volume successfully. Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8de6d90b-5936-4e7b-afa3-13810a9c4e04 tempest-VolumesActionsTest-1440308896 None] Lock "cinder-1db74a80-db93-4454-b013-210273d094f1-delete_volume" released by "delete_volume" :: held 5.085s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:27 devstack cinder-volume[81909]: DEBUG cinder.quota [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Created reservations ['b29b0115-5585-44f8-9158-1bdfc8bfe9e8', 'fafcc3ad-766d-4619-b3c8-5147418b4618', '81f64ed8-062d-4776-82c5-51e985bdb63a', '6e85b4c7-840c-491e-a041-c516a1d42698'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:28 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:28 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:29 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013" returned: 0 in 1.744s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] <== create_volume: return (3312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.316s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:29 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.198s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.manager [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:29 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Deleted volume successfully. Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b106ab-ad0a-4024-8251-47cea89be91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858442d8-e4ee-4788-b911-acb3a6f36013', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a819da3-2829-47d4-a06f-6815d3bdd98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Volume volume-858442d8-e4ee-4788-b911-acb3a6f36013 (858442d8-e4ee-4788-b911-acb3a6f36013): created successfully Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a819da3-2829-47d4-a06f-6815d3bdd98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Flow 'volume_create_manager' (9522099c-bd15-4397-866b-c4f9da622a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-7a142063-83c4-40d4-8a7c-f06a97d9150b req-a2b1befa-de60-46d6-a34f-998e495007cb tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-5b4767e8-e575-4325-a0bd-03ca69b8d24c-delete_volume" released by "delete_volume" :: held 5.985s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:29 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bde550c7-80b4-4102-9868-978a7dc2fa1a tempest-VolumeTypesAccessTest-987030069 None] Created volume successfully. Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Acquiring lock "cinder-858442d8-e4ee-4788-b911-acb3a6f36013-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "cinder-858442d8-e4ee-4788-b911-acb3a6f36013-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Acquiring lock "cinder-quobyte-858442d8-e4ee-4788-b911-acb3a6f36013" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "cinder-quobyte-858442d8-e4ee-4788-b911-acb3a6f36013" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b78d6b-0293-4639-a02b-719cbe5d5301]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:30 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 Apr 24 15:31:30 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:31 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013" returned: 0 in 0.848s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:31 devstack sudo[85367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013 Apr 24 15:31:31 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:32 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-858442d8-e4ee-4788-b911-acb3a6f36013" returned: 0 in 0.802s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "cinder-quobyte-858442d8-e4ee-4788-b911-acb3a6f36013" released by "delete_volume" :: held 1.737s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:32 devstack cinder-volume[81909]: WARNING cinder.quota [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-508453528 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-508453528, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:31:32 devstack cinder-volume[81909]: WARNING cinder.quota [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-508453528 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-508453528, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Created reservations ['f54bf7c2-faad-4a0a-8b5c-3a91c1d00f8a', '23395ac8-ed65-482e-9b6f-3fc48faaf6fa', '84dec4b1-0f9b-4bc0-ab87-8669121e9e0f', '357c8e1a-c4d6-474b-9de3-8c6b2ecc793f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:32 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:32 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:33 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.341s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:33 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Deleted volume successfully. Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3af53b6d-b948-4b3c-b84a-7ee9ad8dac2e tempest-VolumeTypesAccessTest-987030069 None] Lock "cinder-858442d8-e4ee-4788-b911-acb3a6f36013-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Flow 'volume_create_manager' (6429bcab-bb1d-4539-9563-a20e7dd34271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f62e43-d5f8-478a-b92c-2ef201c26a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f62e43-d5f8-478a-b92c-2ef201c26a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1125527505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4502633-3431-478a-851e-ad26d4803de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ed2759788493e9ba9c071a672cc58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:34Z,use_quota=True,user_id='4cfba9fa19a04850bfb1d610a25f59d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad8ded6-a70a-4767-8ca3-48092dcaf7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad8ded6-a70a-4767-8ca3-48092dcaf7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e7ad91-2795-47b0-9c57-f474e1869c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e7ad91-2795-47b0-9c57-f474e1869c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4502633-3431-478a-851e-ad26d4803de7', 'volume_name': 'volume-c4502633-3431-478a-851e-ad26d4803de7', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbd131c-d494-47d0-9fc2-75ec29feeaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbd131c-d494-47d0-9fc2-75ec29feeaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9491a12e-a83c-4e2a-b2f4-6141b24f7c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:34 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Volume c4502633-3431-478a-851e-ad26d4803de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4502633-3431-478a-851e-ad26d4803de7', 'volume_size': 1} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1125527505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4502633-3431-478a-851e-ad26d4803de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ed2759788493e9ba9c071a672cc58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:34Z,use_quota=True,user_id='4cfba9fa19a04850bfb1d610a25f59d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Creating volume c4502633-3431-478a-851e-ad26d4803de7 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:34 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:34 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 1073741824 Apr 24 15:31:34 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:35 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 1073741824" returned: 0 in 1.005s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:35 devstack sudo[85386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 Apr 24 15:31:35 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:36 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7" returned: 0 in 0.793s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9491a12e-a83c-4e2a-b2f4-6141b24f7c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4502633-3431-478a-851e-ad26d4803de7', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28019e3a-d77b-4ba4-97db-6c3abd73b375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Volume volume-c4502633-3431-478a-851e-ad26d4803de7 (c4502633-3431-478a-851e-ad26d4803de7): created successfully Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28019e3a-d77b-4ba4-97db-6c3abd73b375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Flow 'volume_create_manager' (6429bcab-bb1d-4539-9563-a20e7dd34271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-62003bb4-97de-4941-a060-ee29a3bf5005 tempest-ServerRescueNegativeTestJSON-1756380682 None] Created volume successfully. Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Flow 'volume_create_manager' (56cc1181-338a-496c-ae3a-4c09fe1bcc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f67e46b-b617-4bd9-b298-54360805a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f67e46b-b617-4bd9-b298-54360805a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-933408399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc290d40-69a0-43ec-a61d-51a638d7c601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea1744412ed4f44b9fedd0a7f1d2ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:42Z,use_quota=True,user_id='f8a02be76aa948489dc040135aac9b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f9d761-b894-49b6-b90a-912e5637e69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f9d761-b894-49b6-b90a-912e5637e69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4838d-fcba-4b4d-a42c-a254900469eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4838d-fcba-4b4d-a42c-a254900469eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc290d40-69a0-43ec-a61d-51a638d7c601', 'volume_name': 'volume-bc290d40-69a0-43ec-a61d-51a638d7c601', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d9c4e7-07ff-4ae1-a4e3-9b5ebb5f64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d9c4e7-07ff-4ae1-a4e3-9b5ebb5f64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056013fc-52a3-4a5e-a1f0-2ec59ab444bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:42 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Volume bc290d40-69a0-43ec-a61d-51a638d7c601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc290d40-69a0-43ec-a61d-51a638d7c601', 'volume_size': 1} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-933408399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc290d40-69a0-43ec-a61d-51a638d7c601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea1744412ed4f44b9fedd0a7f1d2ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:42Z,use_quota=True,user_id='f8a02be76aa948489dc040135aac9b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Creating volume bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:42 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-16efb8f3-de73-439a-bd5b-ff5cbb9904b2 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Terminate volume connection completed successfully. Apr 24 15:31:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-16efb8f3-de73-439a-bd5b-ff5cbb9904b2 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Deleting attachment 1477818f-7f78-4a3f-90c1-00d71853ce3c. {{(pid=81909) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 15:31:42 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 1073741824 Apr 24 15:31:42 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "cinder-ab44e6ad-0ae4-4445-88bc-468913e3546a-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-ab44e6ad-0ae4-4445-88bc-468913e3546a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "cinder-quobyte-ab44e6ad-0ae4-4445-88bc-468913e3546a" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-quobyte-ab44e6ad-0ae4-4445-88bc-468913e3546a" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e19cb2-3313-44c8-963f-c8af27158813]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:43 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a Apr 24 15:31:43 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:43 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 1073741824" returned: 0 in 1.178s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:43 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 Apr 24 15:31:43 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:44 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601" returned: 0 in 0.861s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056013fc-52a3-4a5e-a1f0-2ec59ab444bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc290d40-69a0-43ec-a61d-51a638d7c601', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db6ce44-1ea1-4bc2-929c-a23ab05bf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:44 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a" returned: 0 in 1.145s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:44 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Volume volume-bc290d40-69a0-43ec-a61d-51a638d7c601 (bc290d40-69a0-43ec-a61d-51a638d7c601): created successfully Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db6ce44-1ea1-4bc2-929c-a23ab05bf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:44 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a Apr 24 15:31:44 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Flow 'volume_create_manager' (56cc1181-338a-496c-ae3a-4c09fe1bcc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ff303ae6-dfb5-4681-a1d9-1595647d7de0 tempest-SnapshotMetadataTestJSON-1283114354 None] Created volume successfully. Apr 24 15:31:45 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ab44e6ad-0ae4-4445-88bc-468913e3546a" returned: 0 in 0.516s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-quobyte-ab44e6ad-0ae4-4445-88bc-468913e3546a" released by "delete_volume" :: held 1.728s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.quota [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Created reservations ['a305b048-ce79-4dba-b0ae-f5d597292b75', 'b91a13cd-7cdd-4c87-b2e7-2f9b89d42c0a', 'c5295c80-5156-4926-98db-6b810d95c63f', 'bd3a31e5-0375-42e9-8d35-0e43daf4f75e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:45 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:45 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:45 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.566s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.manager [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Deleted volume successfully. Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-8bb218bb-f15b-44d8-99c2-b0fc52f032e2 req-1d81386e-fe3a-46e0-99b7-0816ca8d6032 tempest-ServerBootFromVolumeStableRescueTest-1783391647 None] Lock "cinder-ab44e6ad-0ae4-4445-88bc-468913e3546a-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Creating offline snapshot 18c5f36f-7265-444a-83d1-a7336192a5c8 of volume bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[22127a70-08c7-4dd8-90e6-c6dd9d9ff315]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:45 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 Apr 24 15:31:45 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:46 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601" returned: 0 in 0.598s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:46 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 1G Apr 24 15:31:46 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Flow 'volume_create_manager' (75aa30e9-61c7-46bd-b220-0af477c04b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59718b12-69a6-4731-8378-bd0dea0ae001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59718b12-69a6-4731-8378-bd0dea0ae001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-331584432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813c300d-6151-45da-9095-ede69585f5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76006cd472bf4a5d9058035892c08e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:47Z,use_quota=True,user_id='4ead21fdacc54b62a7bf19c4ec7f9b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f9d349-15fc-4ebc-980e-068a6865bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f9d349-15fc-4ebc-980e-068a6865bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c39568-f0c4-4047-a700-66ab4b842624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.image.glance [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Creating Keystone auth plugin from conf {{(pid=81909) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c39568-f0c4-4047-a700-66ab4b842624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '813c300d-6151-45da-9095-ede69585f5ed', 'volume_name': 'volume-813c300d-6151-45da-9095-ede69585f5ed', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d691e4a-5deb-4232-8706-e246231b8448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d691e4a-5deb-4232-8706-e246231b8448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf25e938-9c2b-4483-a96e-486b892d0192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:46 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Volume 813c300d-6151-45da-9095-ede69585f5ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-813c300d-6151-45da-9095-ede69585f5ed', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 15:31:46 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Trying to clone 813c300d-6151-45da-9095-ede69585f5ed from image 35d86ae8-c267-4804-98fd-3c88f2d8852d at location (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]). {{(pid=81909) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 15:31:47 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Image download 20.69 MB at 20.69 MB/s Apr 24 15:31:47 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 1G" returned: 0 in 0.862s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc290d40-69a0-43ec-a61d-51a638d7c601 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:47 devstack sudo[85529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc290d40-69a0-43ec-a61d-51a638d7c601 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 Apr 24 15:31:47 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef502025-79a0-4e30-a60f-a72b50f6a92b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:47 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD Apr 24 15:31:47 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:47 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc290d40-69a0-43ec-a61d-51a638d7c601 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8" returned: 0 in 0.475s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:47 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 is being set with open permissions: ugo+rw Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:47 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 Apr 24 15:31:47 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:47 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d is fetched for user 4ead21fdacc54b62a7bf19c4ec7f9b5d. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6f60d3-5891-4710-9b5b-611f52a3cbca]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:48 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD Apr 24 15:31:48 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:48 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8" returned: 0 in 0.636s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:48 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info Apr 24 15:31:48 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:48 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:49 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:49 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:49 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info" returned: 0 in 0.748s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:49 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info is being set with open permissions: ugo+rw Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:49 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info Apr 24 15:31:49 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:49 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.520s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:49 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.info" returned: 0 in 0.594s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.027s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-331584432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813c300d-6151-45da-9095-ede69585f5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76006cd472bf4a5d9058035892c08e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:31:47Z,use_quota=True,user_id='4ead21fdacc54b62a7bf19c4ec7f9b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Creating volume 813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:31:49 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:31:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-91cc774e-bc9a-443e-a67c-770e035aaf70 tempest-SnapshotMetadataTestJSON-1283114354 None] Create snapshot completed successfully Apr 24 15:31:49 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1073741824 Apr 24 15:31:49 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:50 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1073741824" returned: 0 in 1.104s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:51 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:31:51 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:52 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 0 in 1.063s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Attempting download of 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 813c300d-6151-45da-9095-ede69585f5ed. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67e8b96-dcdc-4e43-b4c0-1c2b6c20d6ae]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "cinder-18c5f36f-7265-444a-83d1-a7336192a5c8-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-18c5f36f-7265-444a-83d1-a7336192a5c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "cinder-quobyte-18c5f36f-7265-444a-83d1-a7336192a5c8" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-18c5f36f-7265-444a-83d1-a7336192a5c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Deleting offline snapshot 18c5f36f-7265-444a-83d1-a7336192a5c8 of volume bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:31:52 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m Apr 24 15:31:52 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] snapshot_file for this snap is: volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd07f33-284d-433d-b85c-a0ba878e4073]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:52 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 Apr 24 15:31:52 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:52 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m" returned: 0 in 0.620s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:52 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m Apr 24 15:31:52 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:53 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8" returned: 0 in 0.732s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc290d40-69a0-43ec-a61d-51a638d7c601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a97c63-b85f-4737-9fb8-5638d7828251]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:53 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 Apr 24 15:31:53 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:53 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m" returned: 1 in 0.552s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_ugn8ji3m' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dbdb1b-26cc-4c4e-be85-4a0bb413a12b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:53 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD Apr 24 15:31:53 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:53 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601" returned: 0 in 0.679s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:53 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 Apr 24 15:31:53 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:54 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:54 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] 35d86ae8-c267-4804-98fd-3c88f2d8852d was qcow2, converting to raw {{(pid=81909) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 15:31:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:54 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:31:54 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:54 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8" returned: 0 in 0.680s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:54 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8 Apr 24 15:31:54 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:55 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601.18c5f36f-7265-444a-83d1-a7336192a5c8" returned: 0 in 0.585s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-18c5f36f-7265-444a-83d1-a7336192a5c8" released by "_delete_snapshot" :: held 2.829s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" released by "delete_snapshot" :: held 2.857s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:55 devstack cinder-volume[81909]: WARNING cinder.quota [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Created reservations ['a5a5634b-0923-4864-86ae-a9b4b72db110', '371d26cc-8fa2-43da-a71c-a0d438293dd1', '6987dcf1-d1b0-4673-a391-6d59166c218b', '61ec5f8f-4a97-4f82-9494-d60dc617482d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:55 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Delete snapshot completed successfully. Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fa513dd5-eecb-4d4e-baab-fe5b6e8584a7 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-18c5f36f-7265-444a-83d1-a7336192a5c8-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "cinder-bc290d40-69a0-43ec-a61d-51a638d7c601-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-bc290d40-69a0-43ec-a61d-51a638d7c601-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd39ad2-7d81-406f-95c8-cef3cba15121]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:55 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 0 in 1.792s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_57xeo7ybdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:31:55 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Converted 112.00 MB image at 62.44 MB/s Apr 24 15:31:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:55 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1G Apr 24 15:31:55 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:55 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 Apr 24 15:31:55 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:56 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed 1G" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:56 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0154c-0623-41c7-9d19-fcd0832c2043]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:56 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601" returned: 0 in 0.686s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:56 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601 Apr 24 15:31:56 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:56 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:31:56 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:57 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-bc290d40-69a0-43ec-a61d-51a638d7c601" returned: 0 in 0.619s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:57 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 0 in 0.651s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-quobyte-bc290d40-69a0-43ec-a61d-51a638d7c601" released by "delete_volume" :: held 1.386s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Created reservations ['6bbc1f9d-12c0-4847-9a5a-65fc8c59ceb5', '59221cb5-b46a-4e69-906a-da6802a087b6', '805cb1da-f76b-414a-bdf8-380bf8038766', '2cf377c1-b78e-4323-b1dc-26a9ca1fa30b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:31:57 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:31:57 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:31:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:57 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:31:57 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:31:58 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 1 in 0.977s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Downloaded image 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 813c300d-6151-45da-9095-ede69585f5ed successfully. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d for user 4ead21fdacc54b62a7bf19c4ec7f9b5d is deleted. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Marking volume 813c300d-6151-45da-9095-ede69585f5ed as bootable. {{(pid=81909) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 15:31:58 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.723s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Copying metadata from image 35d86ae8-c267-4804-98fd-3c88f2d8852d to 813c300d-6151-45da-9095-ede69585f5ed. {{(pid=81909) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Creating volume glance metadata for volume 813c300d-6151-45da-9095-ede69585f5ed backed by image 35d86ae8-c267-4804-98fd-3c88f2d8852d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81909) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 15:31:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Deleted volume successfully. Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8cc8770a-320e-4b65-806c-72aa6effb3d4 tempest-SnapshotMetadataTestJSON-1283114354 None] Lock "cinder-bc290d40-69a0-43ec-a61d-51a638d7c601-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf25e938-9c2b-4483-a96e-486b892d0192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813c300d-6151-45da-9095-ede69585f5ed', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e36f40-fb34-4533-9a98-1a02c3bd8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:31:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Volume volume-813c300d-6151-45da-9095-ede69585f5ed (813c300d-6151-45da-9095-ede69585f5ed): created successfully Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e36f40-fb34-4533-9a98-1a02c3bd8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:31:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Flow 'volume_create_manager' (75aa30e9-61c7-46bd-b220-0af477c04b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:31:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-51d60d84-aef1-420a-98fc-d81f4cd31e85 tempest-VolumesImageMetadata-78475037 None] Created volume successfully. Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Acquiring lock "cinder-813c300d-6151-45da-9095-ede69585f5ed-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "cinder-813c300d-6151-45da-9095-ede69585f5ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Acquiring lock "cinder-quobyte-813c300d-6151-45da-9095-ede69585f5ed" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "cinder-quobyte-813c300d-6151-45da-9095-ede69585f5ed" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37b874-b3ba-42a5-accf-15674526fa67]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:31:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:31:59 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:31:59 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:00 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 0 in 0.829s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:00 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:32:00 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Acquiring lock "cinder-c4502633-3431-478a-851e-ad26d4803de7-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "cinder-c4502633-3431-478a-851e-ad26d4803de7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Acquiring lock "cinder-quobyte-c4502633-3431-478a-851e-ad26d4803de7" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "cinder-quobyte-c4502633-3431-478a-851e-ad26d4803de7" acquired by "delete_volume" :: waited 0.039s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0b4a7-d637-42f8-b54d-3b8848d3e7b7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:01 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 Apr 24 15:32:01 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:01 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 1 in 1.276s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:32:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:01 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed Apr 24 15:32:01 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:02 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7" returned: 0 in 1.387s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:02 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-813c300d-6151-45da-9095-ede69585f5ed" returned: 0 in 0.799s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:02 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7 Apr 24 15:32:02 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "cinder-quobyte-813c300d-6151-45da-9095-ede69585f5ed" released by "delete_volume" :: held 2.998s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Created reservations ['86713666-4cdd-44a0-bc2b-8f0fb1aeef00', '669c9c5a-2f88-4ff8-8bb3-239999607b3e', 'a3accab4-625e-43e4-9357-03fe8147d6e8', '68dc94e8-5073-4b9a-b57c-f8fb3208f85d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:02 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:02 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:03 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c4502633-3431-478a-851e-ad26d4803de7" returned: 0 in 1.039s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "cinder-quobyte-c4502633-3431-478a-851e-ad26d4803de7" released by "delete_volume" :: held 2.495s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Created reservations ['09811f12-f1ce-4313-9751-8a0726df3ccb', '6c9e9c00-9471-47be-8f42-118a59717265', '5795f3d3-60ed-4a0d-9897-3601e7db63d3', '2557922c-3a14-4d68-9ce1-23dace44a34a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:03 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:03 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:03 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.192s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:03 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Deleted volume successfully. Apr 24 15:32:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4838245b-ab7d-41be-b577-8b633c8674fb tempest-VolumesImageMetadata-78475037 None] Lock "cinder-813c300d-6151-45da-9095-ede69585f5ed-delete_volume" released by "delete_volume" :: held 4.561s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:04 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.187s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:04 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Deleted volume successfully. Apr 24 15:32:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab12fac4-fde4-4e7c-b388-036b6b9c4dcf tempest-ServerRescueNegativeTestJSON-1756380682 None] Lock "cinder-c4502633-3431-478a-851e-ad26d4803de7-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Flow 'volume_create_manager' (8fdb6ede-706d-4ae3-9a0f-cc376c2bc44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e57550-8eaf-4fb0-8840-9e8afddfa8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e57550-8eaf-4fb0-8840-9e8afddfa8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-627106162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6fab7a-c60b-4c2a-8da1-e31bc299c625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa4b0f753d4b7e9fbed0201e57f3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:05Z,use_quota=True,user_id='d19f30ee611b48f4a7059668f26d5a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38912b8b-d26c-4c33-990a-9f0968f4942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38912b8b-d26c-4c33-990a-9f0968f4942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e240b6-b634-4b02-95a2-031a75e3b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e240b6-b634-4b02-95a2-031a75e3b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6fab7a-c60b-4c2a-8da1-e31bc299c625', 'volume_name': 'volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e45f17-3d54-4fc1-9686-3566252a6efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e45f17-3d54-4fc1-9686-3566252a6efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0cdaa8-6cdf-4a79-a5a6-8fe92ab129b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:05 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Volume 7c6fab7a-c60b-4c2a-8da1-e31bc299c625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625', 'volume_size': 1} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-627106162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6fab7a-c60b-4c2a-8da1-e31bc299c625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa4b0f753d4b7e9fbed0201e57f3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:05Z,use_quota=True,user_id='d19f30ee611b48f4a7059668f26d5a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Creating volume 7c6fab7a-c60b-4c2a-8da1-e31bc299c625 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:05 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:05 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 1073741824 Apr 24 15:32:05 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:06 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 1073741824" returned: 0 in 1.316s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:06 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 Apr 24 15:32:06 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:07 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Flow 'volume_create_manager' (ead82277-2780-42d3-b1a7-b1754651211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ba995-e60c-41e0-b39a-cbb48a79d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ba995-e60c-41e0-b39a-cbb48a79d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-418849600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff5c617-da22-44d2-8d6e-8f05f9e9f85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b753daa54d48a784df4d175cc4c006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:08Z,use_quota=True,user_id='2ab33f17f6cb4f71b282ce09b9d5d86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce2e79f-403c-4b4d-be23-18e1173bef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce2e79f-403c-4b4d-be23-18e1173bef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b4a949-da07-49b6-9193-d89c7e50ad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b4a949-da07-49b6-9193-d89c7e50ad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff5c617-da22-44d2-8d6e-8f05f9e9f85d', 'volume_name': 'volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f835f-9352-4bb7-9413-85ed96f8cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f835f-9352-4bb7-9413-85ed96f8cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491e642b-244a-4faa-b5a3-6d56262282f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Volume fff5c617-da22-44d2-8d6e-8f05f9e9f85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d', 'volume_size': 1} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" returned: 0 in 1.197s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] <== create_volume: return (2626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-418849600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff5c617-da22-44d2-8d6e-8f05f9e9f85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b753daa54d48a784df4d175cc4c006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:08Z,use_quota=True,user_id='2ab33f17f6cb4f71b282ce09b9d5d86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Creating volume fff5c617-da22-44d2-8d6e-8f05f9e9f85d {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:08 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:08 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d 1073741824 Apr 24 15:32:08 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0cdaa8-6cdf-4a79-a5a6-8fe92ab129b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492d17a3-788a-4657-8093-2a72080d11e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Volume volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 (7c6fab7a-c60b-4c2a-8da1-e31bc299c625): created successfully Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492d17a3-788a-4657-8093-2a72080d11e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Flow 'volume_create_manager' (8fdb6ede-706d-4ae3-9a0f-cc376c2bc44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7d927f47-4e4c-4bac-b9f5-680f04407da8 tempest-AbsoluteLimitsTests-1364699394 None] Created volume successfully. Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Acquiring lock "cinder-7c6fab7a-c60b-4c2a-8da1-e31bc299c625-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "cinder-7c6fab7a-c60b-4c2a-8da1-e31bc299c625-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Acquiring lock "cinder-quobyte-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "cinder-quobyte-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" acquired by "delete_volume" :: waited 0.085s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b58bf17-4289-4199-8123-13874fbe5406]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:08 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 Apr 24 15:32:08 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:09 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d 1073741824" returned: 0 in 1.182s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:09 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d Apr 24 15:32:09 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:09 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" returned: 0 in 0.979s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:09 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625 Apr 24 15:32:09 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:10 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" returned: 0 in 0.672s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491e642b-244a-4faa-b5a3-6d56262282f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04faad09-64b9-4927-af99-80a9e38eddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:10 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Volume volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d (fff5c617-da22-44d2-8d6e-8f05f9e9f85d): created successfully Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04faad09-64b9-4927-af99-80a9e38eddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Flow 'volume_create_manager' (ead82277-2780-42d3-b1a7-b1754651211b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-00149a1f-98cc-4ec7-9b68-fb1fb4001fff tempest-VolumesMetadataTest-467464010 None] Created volume successfully. Apr 24 15:32:10 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" returned: 0 in 0.719s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "cinder-quobyte-7c6fab7a-c60b-4c2a-8da1-e31bc299c625" released by "delete_volume" :: held 1.767s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Created reservations ['4497ba6a-d164-4f87-bf09-d089736ab4b3', '920392d8-aecd-44cc-bcb1-75430d39b5a7', '759c9e1e-91dd-4528-abe6-2efe5fff6da9', 'bf034fc2-a044-455e-83b1-528e6576937e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:10 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:10 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:11 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.483s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:11 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Deleted volume successfully. Apr 24 15:32:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e2c37fb-9e27-49ad-84f3-054b7e16b64b tempest-AbsoluteLimitsTests-1364699394 None] Lock "cinder-7c6fab7a-c60b-4c2a-8da1-e31bc299c625-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Acquiring lock "cinder-fff5c617-da22-44d2-8d6e-8f05f9e9f85d-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "cinder-fff5c617-da22-44d2-8d6e-8f05f9e9f85d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Acquiring lock "cinder-quobyte-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "cinder-quobyte-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a8f4d-3c05-4e67-addd-01ac76fe7728]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:12 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d Apr 24 15:32:12 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:13 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" returned: 0 in 0.845s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:13 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d Apr 24 15:32:13 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:13 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" returned: 0 in 0.687s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "cinder-quobyte-fff5c617-da22-44d2-8d6e-8f05f9e9f85d" released by "delete_volume" :: held 1.597s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Created reservations ['b0df2056-6ae2-4a7e-89f9-2875b1aa560b', 'b101c759-a359-422d-9227-73639414be0b', '53736f3e-622d-4d1b-8b16-e53fe331725b', '8d06f51e-8714-427a-93d8-8c1ea013caea'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:14 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:14 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:14 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.676s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:14 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Deleted volume successfully. Apr 24 15:32:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3fd1a59-aa66-4434-854f-0da8961f3705 tempest-VolumesMetadataTest-467464010 None] Lock "cinder-fff5c617-da22-44d2-8d6e-8f05f9e9f85d-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (16d891f4-a730-49a7-bc4a-be6d6c97ae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efe9ed3-e240-4a61-b2d5-44391312db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efe9ed3-e240-4a61-b2d5-44391312db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1784389717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf38070-99f6-4b94-98fe-e275ebaf4a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4573f402af46158f327c0437a95f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:20Z,use_quota=True,user_id='5dfab321d0474baaa115e456c57ec907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aee29c3-be08-447a-8b15-51b8e93cc92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aee29c3-be08-447a-8b15-51b8e93cc92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b6bf8-4ea3-4aa3-b401-ce005a650e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b6bf8-4ea3-4aa3-b401-ce005a650e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf38070-99f6-4b94-98fe-e275ebaf4a41', 'volume_name': 'volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f23eaa-3e3b-4d18-af6d-5a99eab9dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f23eaa-3e3b-4d18-af6d-5a99eab9dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f79f07-9752-4e44-a3c4-e4be039459f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:19 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Volume cbf38070-99f6-4b94-98fe-e275ebaf4a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41', 'volume_size': 1} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1784389717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf38070-99f6-4b94-98fe-e275ebaf4a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4573f402af46158f327c0437a95f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:20Z,use_quota=True,user_id='5dfab321d0474baaa115e456c57ec907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Creating volume cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:19 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:19 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 1073741824 Apr 24 15:32:19 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:20 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 1073741824" returned: 0 in 1.002s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:20 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=107,cinder:SELECT=81,cinder:INSERT=27,cinder:DELETE=6 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:32:20 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=94,cinder:DELETE=11,cinder:SELECT=74,cinder:INSERT=33 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:32:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:21 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 Apr 24 15:32:21 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:21 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41" returned: 0 in 0.550s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f79f07-9752-4e44-a3c4-e4be039459f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671a68cf-0bcf-4086-92ac-13b3026644ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Volume volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 (cbf38070-99f6-4b94-98fe-e275ebaf4a41): created successfully Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671a68cf-0bcf-4086-92ac-13b3026644ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (16d891f4-a730-49a7-bc4a-be6d6c97ae07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-010dc9d9-01dd-4c89-9645-c576ca5b2ed0 tempest-VolumesDeleteCascade-889935404 None] Created volume successfully. Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Flow 'volume_create_manager' (47f9914f-6435-4057-9cf2-dd9dfb9e380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df55af95-2d87-4d75-835e-77beafac8269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df55af95-2d87-4d75-835e-77beafac8269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-215080302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be98be-ebb8-4d76-8926-b7b3ca029ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d03be39a14bbaa8119be2f0c15095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:22Z,use_quota=True,user_id='00d4f3f4a61d4dd7a1a531fa8d1d91bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a38539d-2855-4026-814d-c7c37af28141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a38539d-2855-4026-814d-c7c37af28141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb203c4-d4d1-4c24-acab-ee586ec25ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb203c4-d4d1-4c24-acab-ee586ec25ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96be98be-ebb8-4d76-8926-b7b3ca029ef5', 'volume_name': 'volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ada107-7d09-4359-8429-beeeea75b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ada107-7d09-4359-8429-beeeea75b28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa7012-19f3-449c-bbc3-2fba183347a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:22 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Volume 96be98be-ebb8-4d76-8926-b7b3ca029ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5', 'volume_size': 1} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-215080302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be98be-ebb8-4d76-8926-b7b3ca029ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d03be39a14bbaa8119be2f0c15095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:22Z,use_quota=True,user_id='00d4f3f4a61d4dd7a1a531fa8d1d91bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Creating volume 96be98be-ebb8-4d76-8926-b7b3ca029ef5 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:22 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:22 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 1073741824 Apr 24 15:32:22 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:22 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 1073741824" returned: 0 in 0.727s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:23 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 Apr 24 15:32:23 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:23 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5" returned: 0 in 0.502s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.244s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa7012-19f3-449c-bbc3-2fba183347a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb8dd32-7b7c-4c7a-a457-70ab03406779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Volume volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 (96be98be-ebb8-4d76-8926-b7b3ca029ef5): created successfully Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb8dd32-7b7c-4c7a-a457-70ab03406779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Flow 'volume_create_manager' (47f9914f-6435-4057-9cf2-dd9dfb9e380d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Creating offline snapshot e4dc5361-8f8d-4264-9595-dd5be10a28c1 of volume cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:32:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7b9b3eac-1735-44e3-b213-0148024c9c72 tempest-VolumesTransfersV357Test-1159546008 None] Created volume successfully. Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4183488-b5ab-4791-8193-1c14da3be724]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:23 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 Apr 24 15:32:23 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:24 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:24 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 1G Apr 24 15:32:24 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2958f2f1-9b22-4dd5-9b59-39490c570678 tempest-VolumesTransfersV357Test-267229581 None] Transfer volume completed successfully. Apr 24 15:32:25 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 1G" returned: 0 in 0.910s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:25 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:25 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:25 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.650s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:25 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 is being set with open permissions: ugo+rw Apr 24 15:32:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:25 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:25 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "cinder-96be98be-ebb8-4d76-8926-b7b3ca029ef5-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-96be98be-ebb8-4d76-8926-b7b3ca029ef5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "cinder-quobyte-96be98be-ebb8-4d76-8926-b7b3ca029ef5" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-quobyte-96be98be-ebb8-4d76-8926-b7b3ca029ef5" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2a26d-032a-41b4-b478-30ff4a0afb29]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:26 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:26 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 Apr 24 15:32:26 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:26 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info Apr 24 15:32:26 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:27 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:27 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info is being set with open permissions: ugo+rw Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:27 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5" returned: 0 in 0.702s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:27 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info Apr 24 15:32:27 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:27 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5 Apr 24 15:32:27 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:27 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96be98be-ebb8-4d76-8926-b7b3ca029ef5" returned: 0 in 0.623s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-quobyte-96be98be-ebb8-4d76-8926-b7b3ca029ef5" released by "delete_volume" :: held 1.384s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:27 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.info" returned: 0 in 0.748s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Created reservations ['c30e7e05-64e0-422b-ac7e-d06a16e238e0', 'a89b623b-6408-4d96-8d80-26e4d56e06e7', '6094d695-61c2-458f-b4a2-22ea60c19a94', 'b5f9da12-2347-4eea-95f8-4ea0e6412481'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:27 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e5a642ee-d024-4d2b-bf14-aa5726671197 tempest-VolumesDeleteCascade-889935404 None] Create snapshot completed successfully Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:27 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:27 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:28 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.787s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Creating offline snapshot 7a90cc40-638d-495c-9753-104704859852 of volume cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:32:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Deleted volume successfully. Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8308ec6-36ed-40a2-ad6d-edf40e948fb9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-00ac047f-c642-483a-9570-7b1db331d839 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-96be98be-ebb8-4d76-8926-b7b3ca029ef5-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:28 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:28 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Flow 'volume_create_manager' (9716dcf5-be9d-4dd4-b473-224537a4f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bec26-1d7b-45d4-9b97-bbc1291a1cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bec26-1d7b-45d4-9b97-bbc1291a1cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-919791666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddcf21f-360b-4e70-9f4d-f85466e5e2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d03be39a14bbaa8119be2f0c15095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:29Z,use_quota=True,user_id='00d4f3f4a61d4dd7a1a531fa8d1d91bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e8af42-c4d4-4aa2-82c2-64fb31ffd0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e8af42-c4d4-4aa2-82c2-64fb31ffd0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdf8ef0-8e66-46d1-801f-734d49b471c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdf8ef0-8e66-46d1-801f-734d49b471c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddcf21f-360b-4e70-9f4d-f85466e5e2f9', 'volume_name': 'volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a1427a-83c0-4ff1-bf4e-48761661136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a1427a-83c0-4ff1-bf4e-48761661136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d5aabd-910f-463c-b2d2-8b2015973c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Volume 4ddcf21f-360b-4e70-9f4d-f85466e5e2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9', 'volume_size': 1} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:29 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.907s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:29 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 1G Apr 24 15:32:29 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:30 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 1G" returned: 0 in 0.844s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:30 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 Apr 24 15:32:30 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:31 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:31 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 is being set with open permissions: ugo+rw Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:31 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 Apr 24 15:32:31 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:31 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852" returned: 0 in 0.476s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-919791666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddcf21f-360b-4e70-9f4d-f85466e5e2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d03be39a14bbaa8119be2f0c15095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:29Z,use_quota=True,user_id='00d4f3f4a61d4dd7a1a531fa8d1d91bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Creating volume 4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:31 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:31 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 1073741824 Apr 24 15:32:31 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b2390fb6-d376-42e0-b6f7-01726b2647c7 tempest-VolumesDeleteCascade-889935404 None] Create snapshot completed successfully Apr 24 15:32:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-cbf38070-99f6-4b94-98fe-e275ebaf4a41-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-cbf38070-99f6-4b94-98fe-e275ebaf4a41-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Performing cascade delete. {{(pid=81909) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-7a90cc40-638d-495c-9753-104704859852-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-7a90cc40-638d-495c-9753-104704859852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-7a90cc40-638d-495c-9753-104704859852" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7a90cc40-638d-495c-9753-104704859852" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Deleting offline snapshot 7a90cc40-638d-495c-9753-104704859852 of volume cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] snapshot_file for this snap is: volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3a7e3-5fbc-438a-8ce3-c6b46d73cdda]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:32 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 Apr 24 15:32:32 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:32 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 1073741824" returned: 0 in 0.910s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:32 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 Apr 24 15:32:32 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:32 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852" returned: 0 in 0.644s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2f66f-a81d-4420-b697-e69bb275b014]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:32 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:32 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:33 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" returned: 0 in 0.542s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d5aabd-910f-463c-b2d2-8b2015973c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fff0d43-8513-4335-b7ef-2aac0717aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Volume volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 (4ddcf21f-360b-4e70-9f4d-f85466e5e2f9): created successfully Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fff0d43-8513-4335-b7ef-2aac0717aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Flow 'volume_create_manager' (9716dcf5-be9d-4dd4-b473-224537a4f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d57d7325-5e60-49c8-9864-ae7c3ff90b90 tempest-VolumesTransfersV357Test-1159546008 None] Created volume successfully. Apr 24 15:32:33 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.671s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:33 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 Apr 24 15:32:33 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "cinder-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "cinder-quobyte-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-quobyte-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[509291ac-4465-48cd-ba33-f10cbec4f90a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:34 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 Apr 24 15:32:34 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:34 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852" returned: 0 in 0.793s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:34 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852 Apr 24 15:32:34 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:34 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" returned: 0 in 0.671s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:34 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9 Apr 24 15:32:34 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:34 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.7a90cc40-638d-495c-9753-104704859852" returned: 0 in 0.546s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7a90cc40-638d-495c-9753-104704859852" released by "_delete_snapshot" :: held 2.803s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5cce5d68-b707-4b23-82d3-e9d175d9a3d6 tempest-GroupsV314Test-1088136858 None] Group tempest-GroupsV314Test-Group-511265317: creating Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" released by "delete_snapshot" :: held 2.862s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5cce5d68-b707-4b23-82d3-e9d175d9a3d6 tempest-GroupsV314Test-1088136858 None] Group tempest-GroupsV314Test-Group-511265317: created successfully Apr 24 15:32:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5cce5d68-b707-4b23-82d3-e9d175d9a3d6 tempest-GroupsV314Test-1088136858 None] Create group completed successfully. Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['ea09f3ec-98d2-4732-8c59-cecb83ac3509', 'aaf05dfb-83c2-424b-bd33-48dcd444eba0', 'b5c606dd-bb0b-473f-acee-3d4c63b44f6f', 'ff76ddc2-e758-4709-93fb-f495b79dfb85'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Delete snapshot completed successfully. Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-7a90cc40-638d-495c-9753-104704859852-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-e4dc5361-8f8d-4264-9595-dd5be10a28c1-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-e4dc5361-8f8d-4264-9595-dd5be10a28c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-e4dc5361-8f8d-4264-9595-dd5be10a28c1" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:35 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" returned: 0 in 0.609s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-quobyte-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9" released by "delete_volume" :: held 1.337s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-e4dc5361-8f8d-4264-9595-dd5be10a28c1" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Deleting offline snapshot e4dc5361-8f8d-4264-9595-dd5be10a28c1 of volume cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] snapshot_file for this snap is: volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece81b5a-8edf-4836-9673-92608b120e24]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Created reservations ['ae7125d6-ae53-4a2d-8cc5-f93498d73fec', '650a6283-ecc6-47de-84e5-78cf16a91d67', '38367106-04df-40e9-8fff-c5538330037b', '44154bb9-8347-4f85-bafd-ebea9008b9a2'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:35 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:35 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:35 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:35 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:35 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.451s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Deleted volume successfully. Apr 24 15:32:35 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.581s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7f66d492-787e-41f2-975c-19bc4749db60 tempest-VolumesTransfersV357Test-1112161111 None] Lock "cinder-4ddcf21f-360b-4e70-9f4d-f85466e5e2f9-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f54dc-eb18-412c-9686-f67f7c63d5c9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:35 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 Apr 24 15:32:35 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Flow 'volume_create_manager' (14e43de9-6447-4ddd-acea-145a09f3ebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85ed4c5-37f9-4a90-a5a5-7cb690dee6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85ed4c5-37f9-4a90-a5a5-7cb690dee6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843520384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9f34ce8-49b7-4752-a3be-aeff224db6fa,host='devstack@QuobyteHD#QuobyteHD',id=d5e26f11-a27a-4b08-a08b-c33b15a3a9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599b005e262e45749f4b86713a19f947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:37Z,use_quota=True,user_id='f728d74d8d754097b53411495fd097d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8692be9-d40c-4cca-a31e-e1cb821bab85),volume_type_id=c8692be9-d40c-4cca-a31e-e1cb821bab85)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be6eebf-cf37-47bd-b561-21bfd9aed574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be6eebf-cf37-47bd-b561-21bfd9aed574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:36 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1056b0-c2cd-41b6-bc90-053fb4cd8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1056b0-c2cd-41b6-bc90-053fb4cd8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e26f11-a27a-4b08-a08b-c33b15a3a9c4', 'volume_name': 'volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a2f811-c0a8-4491-b086-fd5900b20df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a2f811-c0a8-4491-b086-fd5900b20df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6d28b9-6a7c-4930-86e5-2ae249734e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Volume d5e26f11-a27a-4b08-a08b-c33b15a3a9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4', 'volume_size': 1} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9f34ce8-49b7-4752-a3be-aeff224db6fa,created_at=2026-04-24T13:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843520384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9f34ce8-49b7-4752-a3be-aeff224db6fa,host='devstack@QuobyteHD#QuobyteHD',id=d5e26f11-a27a-4b08-a08b-c33b15a3a9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599b005e262e45749f4b86713a19f947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:37Z,use_quota=True,user_id='f728d74d8d754097b53411495fd097d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8692be9-d40c-4cca-a31e-e1cb821bab85),volume_type_id=c8692be9-d40c-4cca-a31e-e1cb821bab85)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Creating volume d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:36 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41" returned: 0 in 1.008s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:36 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 1073741824 Apr 24 15:32:36 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:36 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:36 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:37 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.823s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:37 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1 Apr 24 15:32:37 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:37 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 1073741824" returned: 0 in 1.065s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:38 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:32:38 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:38 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6d28b9-6a7c-4930-86e5-2ae249734e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a108c46b-4765-4058-b894-4e26c1196229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:38 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41.e4dc5361-8f8d-4264-9595-dd5be10a28c1" returned: 0 in 0.912s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Volume volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 (d5e26f11-a27a-4b08-a08b-c33b15a3a9c4): created successfully Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a108c46b-4765-4058-b894-4e26c1196229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Flow 'volume_create_manager' (14e43de9-6447-4ddd-acea-145a09f3ebf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-e4dc5361-8f8d-4264-9595-dd5be10a28c1" released by "_delete_snapshot" :: held 3.493s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" released by "delete_snapshot" :: held 3.547s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f5297563-cc6d-4386-b4f3-ef2a8045da35 tempest-GroupsV314Test-1088136858 None] Created volume successfully. Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['bb02e648-009c-4f59-950b-6919d86cb378', 'aabec290-c10f-4f57-97aa-15d2e5d88847', '1aaa14f1-293a-4b1a-86ff-73230cb82bc5', '4b511213-f16c-4909-82c0-42fd5ddfc06d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Delete snapshot completed successfully. Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-e4dc5361-8f8d-4264-9595-dd5be10a28c1-delete_snapshot" released by "delete_snapshot" :: held 3.794s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Snapshots deleted, issuing volume delete {{(pid=81909) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 15:32:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" acquired by "delete_volume" :: waited 0.038s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e0b90-d61c-4e4c-bf3c-12e8afcafbd8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:39 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 Apr 24 15:32:39 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:39 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41" returned: 0 in 0.849s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:39 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41 Apr 24 15:32:39 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:40 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Cloning volume d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 to volume 70188c41-5641-45ed-a298-21ab9e7f4a94 Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Creating offline snapshot 1c9654ca-2d7b-499a-af1d-ef05932c7877 of volume d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d40da4f-4fef-40f5-9698-3b0a74db6c8c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:40 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:32:40 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:40 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-cbf38070-99f6-4b94-98fe-e275ebaf4a41" returned: 0 in 0.877s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-cbf38070-99f6-4b94-98fe-e275ebaf4a41" released by "delete_volume" :: held 1.849s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:40 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['80cba320-862f-4149-bb8d-18df20509d45', '257402e6-ad97-4799-a70d-ba1530fe508b', '39f509b7-3503-4fdb-8f2b-07abd2392bbf', '147e66bd-0515-42e9-b35e-ef609fb8a6cd'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:41 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:41 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:41 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.906s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:41 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 1G Apr 24 15:32:41 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:41 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.834s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:41 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Deleted volume successfully. Apr 24 15:32:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-97d4a5c0-cceb-44a3-b7c5-1ee72e629630 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-cbf38070-99f6-4b94-98fe-e275ebaf4a41-delete_volume" released by "delete_volume" :: held 9.926s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:42 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 1G" returned: 0 in 1.061s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:42 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:42 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (28ba943c-c452-48cb-bdc1-7ed50577c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266c9579-2e8b-4eda-a937-4cc8de8718cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266c9579-2e8b-4eda-a937-4cc8de8718cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-515383738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d68351b-7a85-451f-b045-ad6bac20e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4573f402af46158f327c0437a95f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:43Z,use_quota=True,user_id='5dfab321d0474baaa115e456c57ec907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a136139-28f6-47af-9af1-60e423df9800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a136139-28f6-47af-9af1-60e423df9800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bd5dc3-a063-4b47-8f4f-048624ddb17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bd5dc3-a063-4b47-8f4f-048624ddb17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d68351b-7a85-451f-b045-ad6bac20e750', 'volume_name': 'volume-7d68351b-7a85-451f-b045-ad6bac20e750', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e28da-c0a6-4b56-be85-9a9d1e128b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e28da-c0a6-4b56-be85-9a9d1e128b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21128c0e-4859-46b5-9ba2-2d9ac5faa5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:43 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Volume 7d68351b-7a85-451f-b045-ad6bac20e750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d68351b-7a85-451f-b045-ad6bac20e750', 'volume_size': 1} Apr 24 15:32:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:43 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.834s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:43 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:32:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:43 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:43 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:44 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.754s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:44 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info Apr 24 15:32:44 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:44 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:44 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:32:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:44 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info Apr 24 15:32:44 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:45 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.info" returned: 0 in 0.803s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Acquiring lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] snapshot: 1c9654ca-2d7b-499a-af1d-ef05932c7877, volume: 70188c41-5641-45ed-a298-21ab9e7f4a94, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1fc8c-37f9-4b79-a1dc-f967d081cf6b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:45 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:45 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:46 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.769s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb19011-c5c1-460d-be5a-5a0779f91559]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:46 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:32:46 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:47 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.675s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:47 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 Apr 24 15:32:47 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Flow 'volume_create_manager' (e4471bf3-9cfe-40a7-b4c4-3bf61d1364a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355f3ea5-c20a-4a5a-9599-0e1125a5f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355f3ea5-c20a-4a5a-9599-0e1125a5f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1298541256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5def8a-a5e4-4ee2-83c1-d57e92b2c396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928e8bb5507d4becaeea51a7a044c5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:47Z,use_quota=True,user_id='03e308dddc8b4d08892677662675240d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa37702-0b4d-42f4-bd61-cafe20dbd65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa37702-0b4d-42f4-bd61-cafe20dbd65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bf19ce-26cd-46e2-a623-2b138146f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bf19ce-26cd-46e2-a623-2b138146f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5def8a-a5e4-4ee2-83c1-d57e92b2c396', 'volume_name': 'volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5f758-3491-4037-85cd-8268b520b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5f758-3491-4037-85cd-8268b520b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273a085-6b86-4652-8ba7-ba74b6cce3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:47 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396', 'volume_size': 1} Apr 24 15:32:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:49 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:32:49 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:50 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.294s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:50 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:32:54 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94" returned: 0 in 6.873s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53d0de-80df-42a0-9c43-dbcf12ab0809]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:54 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:32:54 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=73,cinder:DELETE=8 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:32:54 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.691s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:32:54 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Converted 1024.00 MB image at 148.95 MB/s Apr 24 15:32:54 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:32:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:54 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 Apr 24 15:32:54 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:55 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" released by "_copy_volume_from_snapshot" :: held 9.583s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Acquiring lock "cinder-quobyte-1c9654ca-2d7b-499a-af1d-ef05932c7877" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-1c9654ca-2d7b-499a-af1d-ef05932c7877" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Deleting offline snapshot 1c9654ca-2d7b-499a-af1d-ef05932c7877 of volume d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] snapshot_file for this snap is: volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b427479-4061-456e-9281-3dddd88e4cbb]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:55 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:55 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:55 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.566s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5056c96-cae3-41a3-bd9d-e2680f795137]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:55 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:32:55 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:56 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.585s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:56 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:56 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:56 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:57 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877 Apr 24 15:32:57 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:57 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4.1c9654ca-2d7b-499a-af1d-ef05932c7877" returned: 0 in 0.432s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-1c9654ca-2d7b-499a-af1d-ef05932c7877" released by "_delete_snapshot" :: held 2.232s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.038s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.465s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-515383738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d68351b-7a85-451f-b045-ad6bac20e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4573f402af46158f327c0437a95f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:43Z,use_quota=True,user_id='5dfab321d0474baaa115e456c57ec907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Creating volume 7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:57 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:57 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 1073741824 Apr 24 15:32:57 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5cc8afc7-5c6c-4978-a6d5-7552f7551e80 tempest-GroupsV314Test-1088136858 None] Create group from source-group-c9f34ce8-49b7-4752-a3be-aeff224db6fa completed successfully. Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Acquiring lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec184e-b00c-4425-b252-1e3f7daf2b31]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:58 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 Apr 24 15:32:58 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:58 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 1073741824" returned: 0 in 0.851s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:58 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:32:58 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:59 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.680s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.594s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1298541256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5def8a-a5e4-4ee2-83c1-d57e92b2c396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928e8bb5507d4becaeea51a7a044c5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:32:47Z,use_quota=True,user_id='03e308dddc8b4d08892677662675240d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Creating volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:32:59 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:59 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 1073741824 Apr 24 15:32:59 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21128c0e-4859-46b5-9ba2-2d9ac5faa5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d68351b-7a85-451f-b045-ad6bac20e750', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d323c-cddf-4d3e-981e-f80ac149382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:32:59 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94" returned: 0 in 0.972s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:32:59 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Volume volume-7d68351b-7a85-451f-b045-ad6bac20e750 (7d68351b-7a85-451f-b045-ad6bac20e750): created successfully Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d323c-cddf-4d3e-981e-f80ac149382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (28ba943c-c452-48cb-bdc1-7ed50577c72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:32:59 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94 Apr 24 15:32:59 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:32:59 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-84f6970f-37ea-4d12-82c2-7355087ab2f4 tempest-VolumesDeleteCascade-889935404 None] Created volume successfully. Apr 24 15:32:59 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70188c41-5641-45ed-a298-21ab9e7f4a94" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-70188c41-5641-45ed-a298-21ab9e7f4a94" released by "delete_volume" :: held 1.660s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Created reservations ['a138981d-1d9c-4fbd-800e-faf9feba1529'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:59 devstack cinder-volume[81909]: WARNING cinder.quota [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-880704325 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-880704325, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:32:59 devstack cinder-volume[81909]: WARNING cinder.quota [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-880704325 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-880704325, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Created reservations ['a81d1b47-e7fe-4581-b00d-91001dc62aa0', 'afc425a8-dbc3-4a64-8c42-4a5714392765', 'd1057b89-459d-45cd-90ae-3f237837a3d5', '6b2023ae-e703-424f-abd5-d15ab7568fcb'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:32:59 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 24 15:32:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 1073741824" returned: 0 in 0.885s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:00 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:00 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:00 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 Apr 24 15:33:00 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:00 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.666s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1a7cbc85-7c4e-4b3f-9cbf-134506c0c71c tempest-GroupsV314Test-1088136858 None] Delete group completed successfully. Apr 24 15:33:00 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" returned: 0 in 0.681s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.940s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273a085-6b86-4652-8ba7-ba74b6cce3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f655458-104b-479d-9a5c-a5b45dfbb953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Acquiring lock "cinder-quobyte-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Creating offline snapshot 97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 of volume 7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:00 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Volume volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 (0a5def8a-a5e4-4ee2-83c1-d57e92b2c396): created successfully Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f655458-104b-479d-9a5c-a5b45dfbb953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Flow 'volume_create_manager' (e4471bf3-9cfe-40a7-b4c4-3bf61d1364a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4d3fb0-eb92-498d-8779-af47571193ed]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-87afb974-d68d-4aaf-ac54-f74c30f813ce tempest-VolumesSnapshotListTestJSON-1480065587 None] Created volume successfully. Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" acquired by "delete_volume" :: waited 0.072s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:00 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:00 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b3560-0a22-42d8-b755-086ad0a1fa74]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:01 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:33:01 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:01 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.592s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:01 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 1G Apr 24 15:33:01 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:01 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.765s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:01 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4 Apr 24 15:33:01 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:02 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 1G" returned: 0 in 0.962s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d68351b-7a85-451f-b045-ad6bac20e750 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:02 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" returned: 0 in 0.704s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:02 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d68351b-7a85-451f-b045-ad6bac20e750 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:02 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Lock "cinder-quobyte-d5e26f11-a27a-4b08-a08b-c33b15a3a9c4" released by "delete_volume" :: held 1.565s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Created reservations ['2a893411-078e-4f69-8cb4-25e0003e2a69'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Created reservations ['540d481d-e8f8-4d53-9fd4-aa08abc62ffc', 'd041b025-87d6-432d-a289-00be8255abe4', 'd991ddf1-ae1c-467a-aa0c-543921a89667', '09b09e83-819a-449d-8f57-4705f1a2a22a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:02 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:02 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:03 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d68351b-7a85-451f-b045-ad6bac20e750 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.589s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:03 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 is being set with open permissions: ugo+rw Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:03 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:03 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:03 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.573s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:03 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ab06d374-bc1d-47c2-adb9-33b800ef4fad tempest-GroupsV314Test-1088136858 None] Delete group completed successfully. Apr 24 15:33:03 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.721s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:03 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info Apr 24 15:33:03 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:04 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:04 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info is being set with open permissions: ugo+rw Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:04 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info Apr 24 15:33:04 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:04 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.info" returned: 0 in 0.539s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.103s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.660s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Creating offline snapshot d42da6cb-0ba0-4fe5-a7af-4fae99993f4b of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cfdc96c3-d20d-4505-9af8-46e73a68c861 tempest-VolumesDeleteCascade-889935404 None] Create snapshot completed successfully Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[48893daa-dd47-41ff-911f-7c80d2263852]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:05 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 Apr 24 15:33:05 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:05 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (3edcdb03-96ae-4b5e-8802-bf96c49956c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d415583-4cad-4cba-8f96-171d2e5e044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d415583-4cad-4cba-8f96-171d2e5e044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-878229181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58e934e-041d-4800-b096-8bbae5169f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4573f402af46158f327c0437a95f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:06Z,use_quota=True,user_id='5dfab321d0474baaa115e456c57ec907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dce508-1f14-4ed1-94c2-f2b3d46107a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dce508-1f14-4ed1-94c2-f2b3d46107a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29669cb-fa86-494d-80fc-cf9d330b7640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29669cb-fa86-494d-80fc-cf9d330b7640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f58e934e-041d-4800-b096-8bbae5169f3f', 'volume_name': 'volume-f58e934e-041d-4800-b096-8bbae5169f3f', 'volume_size': 1, 'snapshot_id': '97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f5b5ef-dec5-425f-90e9-566ea3cfad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f5b5ef-dec5-425f-90e9-566ea3cfad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ad6e7a-d1a6-4844-99e6-43e9935da27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:05 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Volume f58e934e-041d-4800-b096-8bbae5169f3f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f58e934e-041d-4800-b096-8bbae5169f3f', 'volume_size': 1, 'snapshot_id': '97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2'} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" returned: 0 in 0.885s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:05 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b 1G Apr 24 15:33:05 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:06 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b 1G" returned: 0 in 0.704s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:06 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:06 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:07 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.581s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:07 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b is being set with open permissions: ugo+rw Apr 24 15:33:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:07 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:07 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:07 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.472s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:07 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info Apr 24 15:33:07 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:08 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info" returned: 0 in 0.557s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:08 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info is being set with open permissions: ugo+rw Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:08 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info Apr 24 15:33:08 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Flow 'volume_create_manager' (2d0e9335-aadc-4923-af1b-de2fbba6bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298ffcd-3b9d-4104-a8c5-62a081dde44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298ffcd-3b9d-4104-a8c5-62a081dde44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1912812110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a04789-3be7-41c9-8df5-3b6591b4a9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7d2cb53e3d4333b0c2bc43d8aec3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:09Z,use_quota=True,user_id='180a2dec744e47faaedb5a6afe2ae7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:08 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58817e83-9dd7-40bd-9b2f-3b26a1162eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58817e83-9dd7-40bd-9b2f-3b26a1162eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1661f0-ecc1-4943-9e6a-022a3b960ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1661f0-ecc1-4943-9e6a-022a3b960ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a04789-3be7-41c9-8df5-3b6591b4a9f2', 'volume_name': 'volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5eca37-c83c-4a54-b8ae-d1806e7f360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5eca37-c83c-4a54-b8ae-d1806e7f360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eaf226-f5bd-4b27-ac88-6ddd504808d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Volume a1a04789-3be7-41c9-8df5-3b6591b4a9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2', 'volume_size': 1} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.info" returned: 0 in 0.640s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.982s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.022s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-f58e934e-041d-4800-b096-8bbae5169f3f" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-657e7188-77b9-46c6-b271-e7ceb99514c1 tempest-VolumesSnapshotListTestJSON-1480065587 None] Create snapshot completed successfully Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-f58e934e-041d-4800-b096-8bbae5169f3f" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Creating volume f58e934e-041d-4800-b096-8bbae5169f3f from snapshot 97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] snapshot: 97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2, volume: f58e934e-041d-4800-b096-8bbae5169f3f, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c31111-f32d-4bd5-aad6-86e318302244]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:09 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:09 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Flow 'volume_create_manager' (719ec680-0826-4b08-b1dd-52eb13b99738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c6ede0-5911-4790-8bb8-5aa3659a6828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c6ede0-5911-4790-8bb8-5aa3659a6828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14211010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c575b30-9367-4e85-8e1d-9eed07883561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bc0fa042c347a0a04b0c49db550210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:09Z,use_quota=True,user_id='43373fa326344b0c9f68ecf4cbdf39f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb96de6-4399-4e96-8500-3d4082adcec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb96de6-4399-4e96-8500-3d4082adcec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f9f99a-5315-4d0d-80de-de95c2289125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f9f99a-5315-4d0d-80de-de95c2289125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c575b30-9367-4e85-8e1d-9eed07883561', 'volume_name': 'volume-0c575b30-9367-4e85-8e1d-9eed07883561', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d8c35a-8529-4835-a022-1ab2b763b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d8c35a-8529-4835-a022-1ab2b763b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee573f0-c3a5-46a5-a9c8-8e6852faaf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Volume 0c575b30-9367-4e85-8e1d-9eed07883561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c575b30-9367-4e85-8e1d-9eed07883561', 'volume_size': 1} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:09 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.530s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d68351b-7a85-451f-b045-ad6bac20e750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd0249-d4a9-4c02-ad49-272e7be3067f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:09 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:09 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:10 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.590s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:10 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:33:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:10 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f Apr 24 15:33:10 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:14 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f" returned: 0 in 4.769s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d51707-cf88-4e23-ae34-20f9818fe949]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:14 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:14 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:15 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:15 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:33:15 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Converted 1024.00 MB image at 214.66 MB/s Apr 24 15:33:15 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f is being set with open permissions: ugo+rw Apr 24 15:33:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:15 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f Apr 24 15:33:15 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:16 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f" returned: 0 in 0.459s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" released by "_copy_volume_from_snapshot" :: held 7.099s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-f58e934e-041d-4800-b096-8bbae5169f3f" released by "_create_volume_from_snapshot" :: held 7.133s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.177s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.226s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1912812110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a04789-3be7-41c9-8df5-3b6591b4a9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7d2cb53e3d4333b0c2bc43d8aec3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:09Z,use_quota=True,user_id='180a2dec744e47faaedb5a6afe2ae7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Creating volume a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:16 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:16 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 1073741824 Apr 24 15:33:16 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ad6e7a-d1a6-4844-99e6-43e9935da27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58e934e-041d-4800-b096-8bbae5169f3f', 'volume_size': 1, 'snapshot_id': '97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecefcadf-6804-43e3-976d-759a2bc6d989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:16 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Volume volume-f58e934e-041d-4800-b096-8bbae5169f3f (f58e934e-041d-4800-b096-8bbae5169f3f): created successfully Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecefcadf-6804-43e3-976d-759a2bc6d989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Flow 'volume_create_manager' (3edcdb03-96ae-4b5e-8802-bf96c49956c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-42a88fe3-6db6-4767-91aa-9698e80e4575 tempest-VolumesDeleteCascade-889935404 None] Created volume successfully. Apr 24 15:33:16 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 1073741824" returned: 0 in 0.634s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:16 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 Apr 24 15:33:16 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-7d68351b-7a85-451f-b045-ad6bac20e750-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-7d68351b-7a85-451f-b045-ad6bac20e750-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Performing cascade delete. {{(pid=81909) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Deleting offline snapshot 97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 of volume 7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] snapshot_file for this snap is: volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dad4ad-c7f2-4c20-9ab5-7efdd0596e95]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:17 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:17 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:17 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.768s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14211010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c575b30-9367-4e85-8e1d-9eed07883561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bc0fa042c347a0a04b0c49db550210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:09Z,use_quota=True,user_id='43373fa326344b0c9f68ecf4cbdf39f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Creating volume 0c575b30-9367-4e85-8e1d-9eed07883561 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:17 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eaf226-f5bd-4b27-ac88-6ddd504808d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d785e27-b769-4a49-bff4-c57a8d6abee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:17 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 1073741824 Apr 24 15:33:17 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:17 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Volume volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 (a1a04789-3be7-41c9-8df5-3b6591b4a9f2): created successfully Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d785e27-b769-4a49-bff4-c57a8d6abee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Flow 'volume_create_manager' (2d0e9335-aadc-4923-af1b-de2fbba6bd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:17 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b6a64512-6003-4b6e-8d2b-5bef5505f0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Created volume successfully. Apr 24 15:33:17 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.579s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d68351b-7a85-451f-b045-ad6bac20e750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[59741beb-825a-46aa-8fae-ce7eb4488bf1]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:17 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:17 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:17 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 1073741824" returned: 0 in 0.667s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:17 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 Apr 24 15:33:17 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:18 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:18 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:18 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:18 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561" returned: 0 in 0.521s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.675s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee573f0-c3a5-46a5-a9c8-8e6852faaf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c575b30-9367-4e85-8e1d-9eed07883561', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c16644-945b-4e3b-8b74-e40629c54cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Creating offline snapshot 324194d8-2077-4139-9a28-42daf7be7352 of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:18 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Volume volume-0c575b30-9367-4e85-8e1d-9eed07883561 (0c575b30-9367-4e85-8e1d-9eed07883561): created successfully Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c16644-945b-4e3b-8b74-e40629c54cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Flow 'volume_create_manager' (719ec680-0826-4b08-b1dd-52eb13b99738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccabe83-4fcd-4b5f-a5bd-acbd0a0ca958]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d4bd0076-1853-43d2-8937-648fa3984063 tempest-ServersNegativeTestJSON-263274021 None] Created volume successfully. Apr 24 15:33:18 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:18 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:18 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.718s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:18 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2 Apr 24 15:33:18 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:19 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.655s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:19 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 1G Apr 24 15:33:19 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:19 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750.97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" returned: 0 in 0.610s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2" released by "_delete_snapshot" :: held 2.527s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" released by "delete_snapshot" :: held 2.550s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['b998b320-0e6e-4064-965f-127a427ababd', '20b5b023-a29f-46e3-a4e7-b131dbd6c66d', '4cd571d1-f4ab-4c66-b781-a579a28e1d6e', 'aec76789-d131-4e38-b91b-b264bc9342a1'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Delete snapshot completed successfully. Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-97f4e638-5dcb-4ca7-bfd9-78db0dda3ff2-delete_snapshot" released by "delete_snapshot" :: held 2.705s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Snapshots deleted, issuing volume delete {{(pid=81909) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d21dde6-46f2-4fe7-87b4-58017d4f171f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:19 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:19 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:19 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 1G" returned: 0 in 0.747s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:20 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:20 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:20 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Flow 'volume_create_manager' (047419e7-8746-4d07-a839-fe8a40437eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eecf74b-67d1-41dd-91fb-99ba417ac5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.660s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:20 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750 Apr 24 15:33:20 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eecf74b-67d1-41dd-91fb-99ba417ac5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1313991516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bc0fa042c347a0a04b0c49db550210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:20Z,use_quota=True,user_id='43373fa326344b0c9f68ecf4cbdf39f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0c5540-3367-4c99-abe7-6a260c0cfd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0c5540-3367-4c99-abe7-6a260c0cfd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0dfb0b-e392-4b1a-936d-e70ac1611dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0dfb0b-e392-4b1a-936d-e70ac1611dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb', 'volume_name': 'volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97927a27-4bbe-403c-b8b9-6f6718894ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97927a27-4bbe-403c-b8b9-6f6718894ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94e6766-ed96-4b8e-b361-e7cb711fa92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Volume 9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb', 'volume_size': 1} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:20 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.602s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:20 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 is being set with open permissions: ugo+rw Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:20 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:20 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:20 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7d68351b-7a85-451f-b045-ad6bac20e750" returned: 0 in 0.447s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-7d68351b-7a85-451f-b045-ad6bac20e750" released by "delete_volume" :: held 1.181s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['98914b3f-06ae-44b9-8d73-b333204889a2', '2cf9388f-9456-45d4-8379-70dcff985afa', '86657665-d5be-4bee-a467-a2254f7f7ec7', '48dc6ec4-9f3e-436d-aacf-b2a5dce17041'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:20 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:20 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:21 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.460s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.356s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=81,cinder:SELECT=106,cinder:DELETE=6,cinder:INSERT=25 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Creating offline snapshot 76135372-a92c-4551-a1c4-9d98af5b725f of volume a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-10777731-03bf-4907-a1b5-5b264afaeb9c tempest-VolumesSnapshotListTestJSON-1480065587 None] Create snapshot completed successfully Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdc3fd0-f82a-4f01-ac41-e75e9aff2f09]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:21 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 Apr 24 15:33:21 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-f58e934e-041d-4800-b096-8bbae5169f3f-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-f58e934e-041d-4800-b096-8bbae5169f3f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8f67fe-cd9b-4540-897e-96d9f64245fe]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:21 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.635s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Deleted volume successfully. Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2eb44187-b283-4ec2-8efd-17a0642ab8a0 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-7d68351b-7a85-451f-b045-ad6bac20e750-delete_volume" released by "delete_volume" :: held 4.759s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:21 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f Apr 24 15:33:21 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:21 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" returned: 0 in 0.678s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:21 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f 1G Apr 24 15:33:21 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:22 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f" returned: 0 in 0.568s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:22 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f Apr 24 15:33:22 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:22 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f 1G" returned: 0 in 0.726s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:22 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f Apr 24 15:33:22 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:22 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f58e934e-041d-4800-b096-8bbae5169f3f" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-quobyte-f58e934e-041d-4800-b096-8bbae5169f3f" released by "delete_volume" :: held 1.149s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Created reservations ['c0c69961-b4f2-426a-8fdd-71fc65b7b069', '233c6265-84d8-4a91-98a9-0877b887d6bb', 'a6f1756f-fe66-4df6-b397-f406070fd78b', 'ba228a4c-467d-483c-9f28-747c17019aad'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:22 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:22 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:23 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:23 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f is being set with open permissions: ugo+rw Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:23 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f Apr 24 15:33:23 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:23 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.491s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Deleted volume successfully. Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-39205ebc-dc04-4c59-b424-47637c770699 tempest-VolumesDeleteCascade-889935404 None] Lock "cinder-f58e934e-041d-4800-b096-8bbae5169f3f-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:23 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f" returned: 0 in 0.468s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:23 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info Apr 24 15:33:23 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:24 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info" returned: 0 in 0.521s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:24 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info is being set with open permissions: ugo+rw Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:24 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info Apr 24 15:33:24 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:24 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.info" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.535s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.232s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1313991516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bc0fa042c347a0a04b0c49db550210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:20Z,use_quota=True,user_id='43373fa326344b0c9f68ecf4cbdf39f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Creating volume 9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:24 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb 1073741824 Apr 24 15:33:24 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-07adc964-8034-4d76-8000-1bca852488e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Create snapshot completed successfully Apr 24 15:33:25 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "cinder-76135372-a92c-4551-a1c4-9d98af5b725f-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb 1073741824" returned: 0 in 0.847s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-76135372-a92c-4551-a1c4-9d98af5b725f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "cinder-quobyte-76135372-a92c-4551-a1c4-9d98af5b725f" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:25 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb Apr 24 15:33:25 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-76135372-a92c-4551-a1c4-9d98af5b725f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Deleting offline snapshot 76135372-a92c-4551-a1c4-9d98af5b725f of volume a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] snapshot_file for this snap is: volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f088b5b4-d411-4b63-a04c-2290f6cfb1e4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:25 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f Apr 24 15:33:25 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:26 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.594s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94e6766-ed96-4b8e-b361-e7cb711fa92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a6b884-abbd-48cd-a96a-fd008d085e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Creating offline snapshot 1a510a60-a3b6-4601-b85f-20d45c5f14b0 of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Volume volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb (9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb): created successfully Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a6b884-abbd-48cd-a96a-fd008d085e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Flow 'volume_create_manager' (047419e7-8746-4d07-a839-fe8a40437eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5b72e-43f3-4636-a7b8-593d2a8a392b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2659e2c2-31cd-4bbf-ad46-67048d3ded66 tempest-ServersNegativeTestJSON-263274021 None] Created volume successfully. Apr 24 15:33:26 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f" returned: 0 in 0.630s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[035376ad-2674-4172-88e7-68d4b382d6e0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:26 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:26 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:26 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 Apr 24 15:33:26 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:26 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:26 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.680s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" returned: 0 in 0.601s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:26 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 1G Apr 24 15:33:26 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:26 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f Apr 24 15:33:26 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "cinder-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "cinder-quobyte-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-quobyte-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef94cc1-8ce0-48b4-b725-182e02a72d7f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:27 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f" returned: 0 in 0.687s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:27 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f Apr 24 15:33:27 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb Apr 24 15:33:27 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:27 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:27 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 1G" returned: 0 in 0.867s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:27 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 Apr 24 15:33:27 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2.76135372-a92c-4551-a1c4-9d98af5b725f" returned: 0 in 0.559s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:28 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" returned: 0 in 0.662s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:28 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb Apr 24 15:33:28 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Flow 'volume_create_manager' (d11903be-0cc4-4896-9a7c-a3572c6333a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721bec18-3193-48d7-9cdc-a2b2cc3d41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-76135372-a92c-4551-a1c4-9d98af5b725f" released by "_delete_snapshot" :: held 2.666s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721bec18-3193-48d7-9cdc-a2b2cc3d41bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-703572443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b281da-deed-483d-b3c0-5ce26b8ce21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a76d96d900847a7bbb9c6ca81fe3789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:28Z,use_quota=True,user_id='4b3e2a98192f49f6a4bc0ca887aacb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2e2e2-4912-4e15-af26-72bc8022e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2e2e2-4912-4e15-af26-72bc8022e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d982e-d5ee-4502-a0d3-fcd9aed70349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d982e-d5ee-4502-a0d3-fcd9aed70349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b281da-deed-483d-b3c0-5ce26b8ce21e', 'volume_name': 'volume-08b281da-deed-483d-b3c0-5ce26b8ce21e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb775e-d8e6-489a-a21a-32a4bc9caf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb775e-d8e6-489a-a21a-32a4bc9caf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253ae18c-2e84-49c8-9639-6c68d90a99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:28 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Volume 08b281da-deed-483d-b3c0-5ce26b8ce21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b281da-deed-483d-b3c0-5ce26b8ce21e', 'volume_size': 1} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" released by "delete_snapshot" :: held 2.737s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Created reservations ['7fd4b051-7287-439c-be45-8450db375907', '182db293-a7fe-493c-8d05-885dfd071478', '47e99012-380e-41cb-bac7-53f3057d1943', '4d326b39-7b0c-4eb0-9380-1fbdc146844d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:28 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0" returned: 0 in 0.595s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:28 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 is being set with open permissions: ugo+rw Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:28 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 Apr 24 15:33:28 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Delete snapshot completed successfully. Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4b1822ce-1e42-472f-9c7d-a915eff2240b tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-76135372-a92c-4551-a1c4-9d98af5b725f-delete_snapshot" released by "delete_snapshot" :: held 2.890s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:28 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" returned: 0 in 0.522s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-quobyte-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb" released by "delete_volume" :: held 1.245s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "cinder-a1a04789-3be7-41c9-8df5-3b6591b4a9f2-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-a1a04789-3be7-41c9-8df5-3b6591b4a9f2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Created reservations ['b58fa3bb-9b0b-44ca-8351-ec88e71e0deb', '75dfff69-21ee-4c64-83a1-2f7216037def', 'fdfbb374-dd85-4cb7-8e8d-f0ee49e62aea', '6c2ba70e-e9ec-4644-8925-4137b877f582'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" acquired by "delete_volume" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:28 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad895af-9e94-4141-9697-2d251e1c116c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0" returned: 0 in 0.551s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-703572443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b281da-deed-483d-b3c0-5ce26b8ce21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a76d96d900847a7bbb9c6ca81fe3789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:28Z,use_quota=True,user_id='4b3e2a98192f49f6a4bc0ca887aacb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Creating volume 08b281da-deed-483d-b3c0-5ce26b8ce21e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:28 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:28 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 Apr 24 15:33:28 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:28 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e 1073741824 Apr 24 15:33:28 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:28 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0209a950-9f83-41cf-a3a9-6ab10d93ca40 tempest-VolumesSnapshotListTestJSON-1480065587 None] Create snapshot completed successfully Apr 24 15:33:29 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" returned: 0 in 0.573s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:29 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2 Apr 24 15:33:29 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:29 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.559s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:29 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Deleted volume successfully. Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3ac1225b-3f31-461c-b14a-afe7fc519c18 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-9dbbe1fd-8e9d-44b7-8f65-1d00368f2acb-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "cinder-0c575b30-9367-4e85-8e1d-9eed07883561-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:29 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e 1073741824" returned: 0 in 0.648s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-0c575b30-9367-4e85-8e1d-9eed07883561-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "cinder-quobyte-0c575b30-9367-4e85-8e1d-9eed07883561" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:29 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e Apr 24 15:33:29 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-quobyte-0c575b30-9367-4e85-8e1d-9eed07883561" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe036dc8-9633-4d33-96e6-2e971f0d096b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:29 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 Apr 24 15:33:29 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:30 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" returned: 0 in 0.604s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-quobyte-a1a04789-3be7-41c9-8df5-3b6591b4a9f2" released by "delete_volume" :: held 1.239s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Created reservations ['f81dcd7f-66ed-491d-8a15-6bde309e90d5', '0d5cd75f-0e8e-4f01-b8c0-703bf7983038', '42905199-bf90-4b48-9492-d3d80851eaaa', 'cc00d759-7a9e-46b0-91e2-c2af0ffd4c07'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:30 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:30 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:30 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561" returned: 0 in 0.618s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:30 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e" returned: 0 in 0.692s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253ae18c-2e84-49c8-9639-6c68d90a99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b281da-deed-483d-b3c0-5ce26b8ce21e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:30 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561 Apr 24 15:33:30 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9838681-5e20-43c6-a3b1-04fdd0bafdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Volume volume-08b281da-deed-483d-b3c0-5ce26b8ce21e (08b281da-deed-483d-b3c0-5ce26b8ce21e): created successfully Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9838681-5e20-43c6-a3b1-04fdd0bafdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Flow 'volume_create_manager' (d11903be-0cc4-4896-9a7c-a3572c6333a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e196da9b-800c-43a6-8a75-8f2f5eaa8941 tempest-VolumesTransfersTest-1530926679 None] Created volume successfully. Apr 24 15:33:30 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.506s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Deleted volume successfully. Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3fd8151-5d77-4e33-bf81-ce45de134a94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1562161160 None] Lock "cinder-a1a04789-3be7-41c9-8df5-3b6591b4a9f2-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-1a510a60-a3b6-4601-b85f-20d45c5f14b0-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-1a510a60-a3b6-4601-b85f-20d45c5f14b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:30 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c575b30-9367-4e85-8e1d-9eed07883561" returned: 0 in 0.523s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-quobyte-0c575b30-9367-4e85-8e1d-9eed07883561" released by "delete_volume" :: held 1.188s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-1a510a60-a3b6-4601-b85f-20d45c5f14b0" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-1a510a60-a3b6-4601-b85f-20d45c5f14b0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Deleting offline snapshot 1a510a60-a3b6-4601-b85f-20d45c5f14b0 of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] snapshot_file for this snap is: volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7a1012-ae21-43e5-a5e8-d39b71f6bd0c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:30 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Created reservations ['178a42aa-1796-492c-87e0-f030a7c48085', 'f01517a0-842e-49fd-b103-07d2023689d6', 'e013ded6-d15e-4479-a5d8-4ca23cb97fc2', '3faf92af-c800-4010-be0a-c8669e3ec4a9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:31 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 Apr 24 15:33:31 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:31 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:31 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:31 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Deleted volume successfully. Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1bc29ed6-f7d5-4c23-9b35-97696b054763 tempest-ServersNegativeTestJSON-263274021 None] Lock "cinder-0c575b30-9367-4e85-8e1d-9eed07883561-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:31 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0" returned: 0 in 0.696s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2745edf-196d-4865-9291-4b882e7a5d03]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:31 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:31 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cee79853-be89-4117-bf09-3800e547139b tempest-VolumesTransfersTest-35329294 None] Transfer volume completed successfully. Apr 24 15:33:32 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.720s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:32 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 Apr 24 15:33:32 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:33 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0" returned: 0 in 0.888s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:33 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0 Apr 24 15:33:33 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "cinder-08b281da-deed-483d-b3c0-5ce26b8ce21e-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-08b281da-deed-483d-b3c0-5ce26b8ce21e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "cinder-quobyte-08b281da-deed-483d-b3c0-5ce26b8ce21e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-quobyte-08b281da-deed-483d-b3c0-5ce26b8ce21e" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf163b78-bb88-484d-8b43-04259077183d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:33 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e Apr 24 15:33:33 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:34 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.1a510a60-a3b6-4601-b85f-20d45c5f14b0" returned: 0 in 0.742s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-1a510a60-a3b6-4601-b85f-20d45c5f14b0" released by "_delete_snapshot" :: held 3.144s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" released by "delete_snapshot" :: held 3.180s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Created reservations ['ca38897b-26c7-4972-902c-bde00fdd342b', '8f12fa04-d2d1-4917-b732-7dd9f83f7924', 'ea43384d-3108-455e-a295-a57a23bf16cb', '8d5a649b-a0b6-4b9c-b182-ddccf1b1fe01'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Delete snapshot completed successfully. Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-908829cf-4f5c-45bd-9453-68dbb1122c30 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-1a510a60-a3b6-4601-b85f-20d45c5f14b0-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:34 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e" returned: 0 in 0.693s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:34 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e Apr 24 15:33:34 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:35 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-08b281da-deed-483d-b3c0-5ce26b8ce21e" returned: 0 in 0.499s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-324194d8-2077-4139-9a28-42daf7be7352-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-quobyte-08b281da-deed-483d-b3c0-5ce26b8ce21e" released by "delete_volume" :: held 1.276s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-324194d8-2077-4139-9a28-42daf7be7352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" acquired by "delete_snapshot" :: waited 0.045s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-324194d8-2077-4139-9a28-42daf7be7352" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-324194d8-2077-4139-9a28-42daf7be7352" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Deleting offline snapshot 324194d8-2077-4139-9a28-42daf7be7352 of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] snapshot_file for this snap is: volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a1c67-719d-4226-9df2-a1bc45112382]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Created reservations ['7a2625eb-2133-438b-8c07-e776e7573f9d', 'f9216092-75ec-4885-9a11-684878ef53f6', 'b18df8ce-87b6-4022-9e0e-e21cfa39c3a6', '71ef6df8-30b3-4a04-aa43-2b46dcbbe00f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:35 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:35 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:35 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:35 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:35 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.625s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[43584923-6ce3-44c4-997d-f6b4068bace2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:36 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Deleted volume successfully. Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f049362-939b-4797-8cea-e375d6f95877 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-08b281da-deed-483d-b3c0-5ce26b8ce21e-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:36 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:36 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Flow 'volume_create_manager' (dcec8321-8167-439f-9c8e-2cdadc33a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642f9894-30f7-4dd2-b617-82f2a938a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642f9894-30f7-4dd2-b617-82f2a938a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-461982937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de998668-4b14-448c-a843-189c8e5b11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a76d96d900847a7bbb9c6ca81fe3789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:36Z,use_quota=True,user_id='4b3e2a98192f49f6a4bc0ca887aacb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a0d9dd-62c8-4f37-8ff5-304390b06c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a0d9dd-62c8-4f37-8ff5-304390b06c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10a6f2c-6def-4d01-94bb-3a9ab6cd370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10a6f2c-6def-4d01-94bb-3a9ab6cd370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de998668-4b14-448c-a843-189c8e5b11fd', 'volume_name': 'volume-de998668-4b14-448c-a843-189c8e5b11fd', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c7850a-d710-4912-bea0-600f13214d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c7850a-d710-4912-bea0-600f13214d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61bd5b-5256-490f-957f-6dfa8a3a933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Volume de998668-4b14-448c-a843-189c8e5b11fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de998668-4b14-448c-a843-189c8e5b11fd', 'volume_size': 1} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-461982937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de998668-4b14-448c-a843-189c8e5b11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a76d96d900847a7bbb9c6ca81fe3789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:36Z,use_quota=True,user_id='4b3e2a98192f49f6a4bc0ca887aacb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Creating volume de998668-4b14-448c-a843-189c8e5b11fd {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:36 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:36 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd 1073741824 Apr 24 15:33:36 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:36 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.648s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:36 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:36 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:37 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd 1073741824" returned: 0 in 0.696s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:37 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.710s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:37 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352 Apr 24 15:33:37 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:37 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd Apr 24 15:33:37 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:37 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.324194d8-2077-4139-9a28-42daf7be7352" returned: 0 in 0.530s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-324194d8-2077-4139-9a28-42daf7be7352" released by "_delete_snapshot" :: held 2.670s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" released by "delete_snapshot" :: held 2.699s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:37 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Created reservations ['048fb9aa-96b6-43eb-9abd-573d1cc8b874', '4f1be9ab-39fa-4393-bab2-9515f8daa691', '6c52a890-a227-40fc-a9b7-f76b60deb2cd', 'ead13ecc-bf6e-4e4c-9ba3-ccd11c79181f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:38 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Delete snapshot completed successfully. Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9a4e1ebc-a3df-4d6f-a2f7-d80667a7d4ae tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-324194d8-2077-4139-9a28-42daf7be7352-delete_snapshot" released by "delete_snapshot" :: held 2.884s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a61bd5b-5256-490f-957f-6dfa8a3a933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de998668-4b14-448c-a843-189c8e5b11fd', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e40560c-7b99-4ff4-b04f-fdcd3ab61ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Volume volume-de998668-4b14-448c-a843-189c8e5b11fd (de998668-4b14-448c-a843-189c8e5b11fd): created successfully Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e40560c-7b99-4ff4-b04f-fdcd3ab61ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Flow 'volume_create_manager' (dcec8321-8167-439f-9c8e-2cdadc33a493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2dc80c06-915d-4442-b7f1-0a09547c8a02 tempest-VolumesTransfersTest-1530926679 None] Created volume successfully. Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Deleting offline snapshot d42da6cb-0ba0-4fe5-a7af-4fae99993f4b of volume 0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] snapshot_file for this snap is: volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff2b6f-872e-4dfe-bb21-6da0b2540fea]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:38 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:38 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "cinder-de998668-4b14-448c-a843-189c8e5b11fd-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-de998668-4b14-448c-a843-189c8e5b11fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "cinder-quobyte-de998668-4b14-448c-a843-189c8e5b11fd" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-quobyte-de998668-4b14-448c-a843-189c8e5b11fd" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09c9e7-0d0f-43bc-9215-716d6fae03f8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:39 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd Apr 24 15:33:39 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:39 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.732s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[90744c8f-8431-474a-8cc6-1ab00e25940e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:39 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 Apr 24 15:33:39 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:39 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd" returned: 0 in 0.648s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:39 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd Apr 24 15:33:39 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:40 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" returned: 0 in 0.626s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:40 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:40 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:40 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de998668-4b14-448c-a843-189c8e5b11fd" returned: 0 in 0.530s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-quobyte-de998668-4b14-448c-a843-189c8e5b11fd" released by "delete_volume" :: held 1.230s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Created reservations ['f071c219-936a-42b6-8b4a-f5d4da4d65af', '52e21259-0541-495a-9b0d-deaf116b62e8', '5094c7cf-88cd-44af-b440-470a4b5612d1', 'c341b9c6-baaf-4f0e-a6bc-c0a37d48e786'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:40 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:40 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:40 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.677s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:40 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b Apr 24 15:33:40 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:41 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:41 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Deleted volume successfully. Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-0c8e10ec-a91b-474f-9364-2b3c09d53ef5 tempest-VolumesTransfersTest-554851329 None] Lock "cinder-de998668-4b14-448c-a843-189c8e5b11fd-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:41 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396.d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" returned: 0 in 0.685s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b" released by "_delete_snapshot" :: held 2.898s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" released by "delete_snapshot" :: held 2.931s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Created reservations ['390c542e-4609-4cc7-a9a8-2a76e8c1275b', '58139daa-c9a0-42c0-b6a3-d9cf4ba723f9', '3a2e3497-1699-4279-be4f-fe7679eb6898', '6607a3df-77e1-4eff-a178-eedcf0492792'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:41 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Delete snapshot completed successfully. Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-eaba90f7-91a3-4f16-981a-6743c44dcc50 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-d42da6cb-0ba0-4fe5-a7af-4fae99993f4b-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" acquired by "delete_volume" :: waited 0.030s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1aabd-8727-4e49-bfe4-430a7e320b2f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:42 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 Apr 24 15:33:42 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:42 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" returned: 0 in 0.673s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:42 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396 Apr 24 15:33:42 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:43 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" returned: 0 in 0.766s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-quobyte-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396" released by "delete_volume" :: held 1.525s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Created reservations ['056f6682-a09e-4647-8257-f1d938355b60', '37e8d01e-fc3c-43ec-b3ca-3efd662a43cb', '27b4c5c7-566b-4045-8a4e-72d2d29709b7', '2444b7b1-f1e4-4e87-937d-89f26aadb9e3'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:43 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:43 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:44 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.708s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:44 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Deleted volume successfully. Apr 24 15:33:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e6a69a57-1aba-4412-a672-9cdad96ce309 tempest-VolumesSnapshotListTestJSON-1480065587 None] Lock "cinder-0a5def8a-a5e4-4ee2-83c1-d57e92b2c396-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:33:48 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:48 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Flow 'volume_create_manager' (aba0f3b4-0508-4d55-992a-0f79e9a49e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:48 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add0f8f2-a637-4fa3-913d-bcd1a6f092ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add0f8f2-a637-4fa3-913d-bcd1a6f092ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d505fc0-83a8-4d06-8f2b-c72fa08f9aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82039ab574b84254b9df87f20fd2b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:49Z,use_quota=True,user_id='5627d59325934470b1f8c6b7e302dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96ee2c7-1687-4c53-b206-6fa5795ebc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96ee2c7-1687-4c53-b206-6fa5795ebc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe787cad-f341-41fe-bb52-a6116df94448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe787cad-f341-41fe-bb52-a6116df94448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d505fc0-83a8-4d06-8f2b-c72fa08f9aba', 'volume_name': 'volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1da81d-a35f-495e-8ed1-c78ac2b793cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1da81d-a35f-495e-8ed1-c78ac2b793cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7f85ab-4dc8-4cd2-8ed7-c6f633d4a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Volume 2d505fc0-83a8-4d06-8f2b-c72fa08f9aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba', 'volume_size': 1} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d505fc0-83a8-4d06-8f2b-c72fa08f9aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82039ab574b84254b9df87f20fd2b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:49Z,use_quota=True,user_id='5627d59325934470b1f8c6b7e302dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Creating volume 2d505fc0-83a8-4d06-8f2b-c72fa08f9aba {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:49 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:49 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba 1073741824 Apr 24 15:33:49 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:49 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:33:49 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:49 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.675s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Flow 'volume_create_manager' (f990deba-bb5a-4dfb-9645-2b689afcd2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fd0cc9-10d7-4525-8726-ae88f9abe45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fd0cc9-10d7-4525-8726-ae88f9abe45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1695409352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a15a5b-8244-4c37-9a93-c02fed3b18fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d792d49bb4341a38359b265a525208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:50Z,use_quota=True,user_id='68af6b91c818418a91d20a151b8dc564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d2af68-e05b-431b-897d-8c2bf6b559b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d2af68-e05b-431b-897d-8c2bf6b559b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deffada5-9849-4e52-8f13-265755f7e98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deffada5-9849-4e52-8f13-265755f7e98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a15a5b-8244-4c37-9a93-c02fed3b18fe', 'volume_name': 'volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da158d4e-843b-48c1-9bda-4d46af27f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da158d4e-843b-48c1-9bda-4d46af27f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd5278-56fc-405b-bb29-2a2c27956acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:49 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Volume 70a15a5b-8244-4c37-9a93-c02fed3b18fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe', 'volume_size': 1} Apr 24 15:33:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:50 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba 1073741824" returned: 0 in 1.168s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:50 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba Apr 24 15:33:50 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:50 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1695409352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a15a5b-8244-4c37-9a93-c02fed3b18fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d792d49bb4341a38359b265a525208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:50Z,use_quota=True,user_id='68af6b91c818418a91d20a151b8dc564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Creating volume 70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:50 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7f85ab-4dc8-4cd2-8ed7-c6f633d4a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:50 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe 1073741824 Apr 24 15:33:50 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80b10a2-785f-4fc9-bfa1-5c439ad52565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:50 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Volume volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba (2d505fc0-83a8-4d06-8f2b-c72fa08f9aba): created successfully Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80b10a2-785f-4fc9-bfa1-5c439ad52565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Flow 'volume_create_manager' (aba0f3b4-0508-4d55-992a-0f79e9a49e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f77b6457-7b52-4978-a565-40615c714457 tempest-CinderUnicodeTest-251024747 None] Created volume successfully. Apr 24 15:33:51 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe 1073741824" returned: 0 in 0.839s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Flow 'volume_create_manager' (45f4e6a0-342c-4713-95ac-b0cf77e5ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:51 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe Apr 24 15:33:51 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4d97ac-ed0c-43de-b5ab-cf3f7f62e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4d97ac-ed0c-43de-b5ab-cf3f7f62e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2017288064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045eaf5c-1afc-4e29-bb72-553371530989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82039ab574b84254b9df87f20fd2b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:52Z,use_quota=True,user_id='5627d59325934470b1f8c6b7e302dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b07977-713b-49fc-8626-9267556d9385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b07977-713b-49fc-8626-9267556d9385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853c2bb4-ca09-4f15-ac1b-7b11e7193328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853c2bb4-ca09-4f15-ac1b-7b11e7193328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045eaf5c-1afc-4e29-bb72-553371530989', 'volume_name': 'volume-045eaf5c-1afc-4e29-bb72-553371530989', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e0c97a-b555-41f1-af7c-539784c74561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e0c97a-b555-41f1-af7c-539784c74561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b4d67-e44f-41e9-ad17-93a457471fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:51 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Volume 045eaf5c-1afc-4e29-bb72-553371530989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045eaf5c-1afc-4e29-bb72-553371530989', 'volume_size': 1} Apr 24 15:33:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:52 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe" returned: 0 in 0.556s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2017288064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045eaf5c-1afc-4e29-bb72-553371530989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82039ab574b84254b9df87f20fd2b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:52Z,use_quota=True,user_id='5627d59325934470b1f8c6b7e302dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Creating volume 045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:33:52 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd5278-56fc-405b-bb29-2a2c27956acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adf01c8-1257-4916-a3e9-5c9487033616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:52 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 1073741824 Apr 24 15:33:52 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:52 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Volume volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe (70a15a5b-8244-4c37-9a93-c02fed3b18fe): created successfully Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adf01c8-1257-4916-a3e9-5c9487033616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Flow 'volume_create_manager' (f990deba-bb5a-4dfb-9645-2b689afcd2f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:52 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-bf5fde4e-dd65-4636-a99e-d6d459885c9e req-413cd301-fcac-4526-8d11-5ea1047c1901 tempest-VolumesSnapshotsTestJSON-1407342584 None] Created volume successfully. Apr 24 15:33:53 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 1073741824" returned: 0 in 0.903s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:53 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 Apr 24 15:33:53 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:54 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989" returned: 0 in 0.796s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.599s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b4d67-e44f-41e9-ad17-93a457471fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045eaf5c-1afc-4e29-bb72-553371530989', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8321baff-9bc3-4a80-82f9-716b33656a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Creating offline snapshot 29a62318-f403-4653-98e7-a3fdd90ba065 of volume 70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:54 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Volume volume-045eaf5c-1afc-4e29-bb72-553371530989 (045eaf5c-1afc-4e29-bb72-553371530989): created successfully Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8321baff-9bc3-4a80-82f9-716b33656a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Flow 'volume_create_manager' (45f4e6a0-342c-4713-95ac-b0cf77e5ee35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b0112-1479-492f-8207-39811a43c33f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a62dda0e-d1f9-4c09-b985-b674bbf2d805 tempest-CinderUnicodeTest-251024747 None] Created volume successfully. Apr 24 15:33:54 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe Apr 24 15:33:54 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:54 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:54 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 1G Apr 24 15:33:54 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:55 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=161,cinder:SELECT=128,cinder:INSERT=35,cinder:DELETE=10 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:33:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:55 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 1G" returned: 0 in 0.967s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:55 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 Apr 24 15:33:55 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:55 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Flow 'volume_create_manager' (27bc7f16-5033-4b73-a2d0-7e4a9ab58c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d996b97-528b-43fb-a1a2-ac4668896965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d996b97-528b-43fb-a1a2-ac4668896965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1814287328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d3959f-4471-4688-bf36-18055d4f3901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a3fa5eaf9d4c8a94543ed9a255166a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:56Z,use_quota=True,user_id='6412606d1257420099b9b50ae85010e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ce013d-ecff-444c-999e-dce050073fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ce013d-ecff-444c-999e-dce050073fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1ee3f3-6692-4da2-8220-b72c379fcbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.image.glance [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Creating Keystone auth plugin from conf {{(pid=81909) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1ee3f3-6692-4da2-8220-b72c379fcbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22d3959f-4471-4688-bf36-18055d4f3901', 'volume_name': 'volume-22d3959f-4471-4688-bf36-18055d4f3901', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeff6e63-ba76-4412-b152-d3576666872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeff6e63-ba76-4412-b152-d3576666872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e13b39-e605-46ef-a9cc-be74ab87e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:33:56 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Volume 22d3959f-4471-4688-bf36-18055d4f3901: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22d3959f-4471-4688-bf36-18055d4f3901', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Trying to clone 22d3959f-4471-4688-bf36-18055d4f3901 from image 35d86ae8-c267-4804-98fd-3c88f2d8852d at location (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]). {{(pid=81909) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 15:33:56 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065" returned: 0 in 0.633s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:56 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 is being set with open permissions: ugo+rw Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:56 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 Apr 24 15:33:56 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 15:33:56 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Image download 20.69 MB at 20.69 MB/s Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1d027-440e-49c4-85ce-ee728ff7fdba]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:56 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD Apr 24 15:33:56 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:56 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065" returned: 0 in 0.575s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:57 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info Apr 24 15:33:57 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:57 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d is fetched for user 6412606d1257420099b9b50ae85010e5. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af0527-c74d-43b1-9c99-0a288060743a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:57 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD Apr 24 15:33:57 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:57 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:57 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info is being set with open permissions: ugo+rw Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:57 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info Apr 24 15:33:57 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:57 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:33:58 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.info" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.643s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Creating offline snapshot 2c0ef434-27d2-4aee-898a-992564cc86fa of volume 045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:33:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-46055eac-8b5e-466e-8c5e-56c62b8939eb req-da187d28-371f-464b-8147-2135fc32f4f9 tempest-VolumesSnapshotsTestJSON-1407342584 None] Create snapshot completed successfully Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c989ebb6-203c-4769-99e0-57427ee8c5df]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:58 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 Apr 24 15:33:58 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "cinder-29a62318-f403-4653-98e7-a3fdd90ba065-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-29a62318-f403-4653-98e7-a3fdd90ba065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "cinder-quobyte-29a62318-f403-4653-98e7-a3fdd90ba065" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-29a62318-f403-4653-98e7-a3fdd90ba065" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Deleting offline snapshot 29a62318-f403-4653-98e7-a3fdd90ba065 of volume 70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] snapshot_file for this snap is: volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c486b-c1b8-42b9-81b5-ed1bad0c1fd6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:58 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 Apr 24 15:33:58 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:58 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989" returned: 0 in 0.644s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:58 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa 1G Apr 24 15:33:58 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:59 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d971ac24-7335-4484-b5a6-bb9f6c01bbd5]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:59 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe Apr 24 15:33:59 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:59 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa 1G" returned: 0 in 0.707s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045eaf5c-1afc-4e29-bb72-553371530989 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:59 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045eaf5c-1afc-4e29-bb72-553371530989 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa Apr 24 15:33:59 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:33:59 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe" returned: 0 in 0.648s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:33:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:33:59 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 Apr 24 15:33:59 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:00 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045eaf5c-1afc-4e29-bb72-553371530989 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa" returned: 0 in 0.645s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:00 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa is being set with open permissions: ugo+rw Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:00 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa Apr 24 15:34:00 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:00 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065" returned: 0 in 0.660s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:00 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065 Apr 24 15:34:00 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:00 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa" returned: 0 in 0.525s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:00 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info Apr 24 15:34:00 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:00 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe.29a62318-f403-4653-98e7-a3fdd90ba065" returned: 0 in 0.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-29a62318-f403-4653-98e7-a3fdd90ba065" released by "_delete_snapshot" :: held 2.575s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" released by "delete_snapshot" :: held 2.600s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.quota [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Created reservations ['96da208c-8f5c-40bc-8490-08ec6e6b94a5', '6d6ee187-4972-4144-9f42-186c1f851a7b', 'a5b111e8-ebda-41bc-8559-253389a7409a', '410f26db-f153-4eb3-83f5-19ac27c5c847'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:01 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Delete snapshot completed successfully. Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-3cd5e362-f80a-4f12-ad84-ca29428b8428 req-07c89ad1-8f0d-4b20-a6da-c7c181f7e699 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-29a62318-f403-4653-98e7-a3fdd90ba065-delete_snapshot" released by "delete_snapshot" :: held 2.773s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:01 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info" returned: 0 in 0.612s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:01 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info is being set with open permissions: ugo+rw Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:01 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info Apr 24 15:34:01 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "cinder-70a15a5b-8244-4c37-9a93-c02fed3b18fe-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-70a15a5b-8244-4c37-9a93-c02fed3b18fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef337a4d-c719-4710-8c39-acb4f63f75ba]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:01 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.info" returned: 0 in 0.540s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:01 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe Apr 24 15:34:01 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.796s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.049s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1814287328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d3959f-4471-4688-bf36-18055d4f3901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a3fa5eaf9d4c8a94543ed9a255166a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:33:56Z,use_quota=True,user_id='6412606d1257420099b9b50ae85010e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Creating volume 22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:01 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:01 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1073741824 Apr 24 15:34:01 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:01 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-66ef0976-1ee4-4ba4-98b1-28990c857909 tempest-CinderUnicodeTest-251024747 None] Create snapshot completed successfully Apr 24 15:34:02 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe" returned: 0 in 0.651s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:02 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe Apr 24 15:34:02 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Flow 'volume_create_manager' (b58cd162-5175-426f-8a17-6af6db438709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19b4e87-2436-4a0f-9701-911353971783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19b4e87-2436-4a0f-9701-911353971783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-873219163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b495dd8da74d4fc5b15efc971ba3410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:02Z,use_quota=True,user_id='05eba9fef738416e8d31c8b16ad1c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35d5309-72fa-4e04-8235-1b2c94a4f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35d5309-72fa-4e04-8235-1b2c94a4f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678b0407-65c5-497a-8745-bb7f2f4a39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678b0407-65c5-497a-8745-bb7f2f4a39a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a', 'volume_name': 'volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015818dd-c4a4-493f-aa02-e29c9a43c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015818dd-c4a4-493f-aa02-e29c9a43c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419b9fe1-00b9-46e7-ac42-f1412ac90d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:02 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a', 'volume_size': 1} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:02 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1073741824" returned: 0 in 0.762s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:02 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:02 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-2c0ef434-27d2-4aee-898a-992564cc86fa-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-2c0ef434-27d2-4aee-898a-992564cc86fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-quobyte-2c0ef434-27d2-4aee-898a-992564cc86fa" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-2c0ef434-27d2-4aee-898a-992564cc86fa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Deleting offline snapshot 2c0ef434-27d2-4aee-898a-992564cc86fa of volume 045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] snapshot_file for this snap is: volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[40738e3b-f834-43d6-a076-4739a3451663]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:02 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-70a15a5b-8244-4c37-9a93-c02fed3b18fe" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-quobyte-70a15a5b-8244-4c37-9a93-c02fed3b18fe" released by "delete_volume" :: held 1.253s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:03 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa Apr 24 15:34:03 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.quota [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Created reservations ['9c2f6666-2ad5-4195-9777-e9a64cf593c6', 'cc0f30fd-795c-4841-8cf8-6b74d785682a', '4fbe9a0c-6afe-4ddd-8d54-2fbea1d63617', '9cc0dd7f-47c4-436f-945a-d1179492109b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:03 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:03 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:03 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 0.515s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-873219163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b495dd8da74d4fc5b15efc971ba3410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:02Z,use_quota=True,user_id='05eba9fef738416e8d31c8b16ad1c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Creating volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:03 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Attempting download of 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 22d3959f-4471-4688-bf36-18055d4f3901. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 15:34:03 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a 1073741824 Apr 24 15:34:03 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ae544-81ce-4c06-acf5-162d1265f935]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:03 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n Apr 24 15:34:03 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:03 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa" returned: 0 in 0.661s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-045eaf5c-1afc-4e29-bb72-553371530989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a67c35f-8f4a-4e9e-887a-13d0b01a9ed6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:03 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.manager [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:03 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Deleted volume successfully. Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-fe3e009c-1544-4916-9250-acf3475293e8 req-459baaaa-ddb1-4b7c-8919-8a9c5e73b1e3 tempest-VolumesSnapshotsTestJSON-1407342584 None] Lock "cinder-70a15a5b-8244-4c37-9a93-c02fed3b18fe-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:03 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 Apr 24 15:34:03 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:03 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n" returned: 0 in 0.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:04 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n Apr 24 15:34:04 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:04 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a 1073741824" returned: 0 in 0.753s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:04 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:34:04 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:04 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989" returned: 0 in 0.653s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:04 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa Apr 24 15:34:04 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:04 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.535s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419b9fe1-00b9-46e7-ac42-f1412ac90d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a266c4f8-69df-46c9-a5e0-c33acc223a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Volume volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a (2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a): created successfully Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a266c4f8-69df-46c9-a5e0-c33acc223a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Flow 'volume_create_manager' (b58cd162-5175-426f-8a17-6af6db438709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a7ff8d40-2283-48b0-ae48-dabed54fe98e tempest-VolumesActionsTest-1706277182 None] Created volume successfully. Apr 24 15:34:04 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n" returned: 1 in 0.739s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_nda8jg8n' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7c20b-eae1-4b6f-83c7-2511c68a08da]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:04 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD Apr 24 15:34:04 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:05 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa" returned: 0 in 0.729s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:05 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa Apr 24 15:34:05 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:05 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD" returned: 0 in 0.615s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] 35d86ae8-c267-4804-98fd-3c88f2d8852d was qcow2, converting to raw {{(pid=81909) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:05 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:05 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:05 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989.2c0ef434-27d2-4aee-898a-992564cc86fa" returned: 0 in 0.514s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-2c0ef434-27d2-4aee-898a-992564cc86fa" released by "_delete_snapshot" :: held 2.682s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" released by "delete_snapshot" :: held 2.714s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Created reservations ['a2b3e058-1ec7-4ad7-b187-474054a672f4', '22f7634b-7b2a-41d8-a77d-22828ae247bb', '266e6f02-7bb9-4af2-840c-9c5c20a82fc3', '71bb2283-a79f-45ef-8950-db1feef510fc'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:05 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Delete snapshot completed successfully. Apr 24 15:34:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-13cee94a-ef71-4aeb-b293-9cc17dd6310d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-2c0ef434-27d2-4aee-898a-992564cc86fa-delete_snapshot" released by "delete_snapshot" :: held 2.898s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-045eaf5c-1afc-4e29-bb72-553371530989-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-045eaf5c-1afc-4e29-bb72-553371530989-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09c049-d936-4612-bb57-56dbcff1fe90]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:06 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 Apr 24 15:34:06 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:06 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989" returned: 0 in 0.761s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:07 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 1.715s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_85m10g1_devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:34:07 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Converted 112.00 MB image at 65.22 MB/s Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:07 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989 Apr 24 15:34:07 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:07 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1G Apr 24 15:34:07 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:07 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-045eaf5c-1afc-4e29-bb72-553371530989" returned: 0 in 0.521s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-045eaf5c-1afc-4e29-bb72-553371530989" released by "delete_volume" :: held 1.381s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Created reservations ['db366671-7488-4401-9a3d-7967a443ee96', 'aacc120a-23f4-4466-8681-c6b279e6ada6', '7489f5dd-84fe-42b8-8310-aeedbdb163f1', '9cb77df1-e827-45c4-87c0-6d1c3e93769e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:07 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 1G" returned: 0 in 0.656s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:07 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:07 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e5528-04d4-48b0-ab7f-dd715fc775c2]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:07 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:07 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Flow 'volume_create_manager' (33ea0538-0ef8-428d-be03-af8c2f7051ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4ec310-d4b0-4f79-8136-c99881d1c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4ec310-d4b0-4f79-8136-c99881d1c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1155375967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac92f12-f84f-414f-afb2-a92210c0556e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf9acc21262045da8620ff57c7fb3776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:08Z,use_quota=True,user_id='20c13965810e42c79f7295516dd36d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b1e356-2f6c-4148-b061-fdf1345ffe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b1e356-2f6c-4148-b061-fdf1345ffe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b925bab7-4f20-4517-9819-3b0fd968d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b925bab7-4f20-4517-9819-3b0fd968d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac92f12-f84f-414f-afb2-a92210c0556e', 'volume_name': 'volume-6ac92f12-f84f-414f-afb2-a92210c0556e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69bcb73-06af-4875-817a-0c1a8c465c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69bcb73-06af-4875-817a-0c1a8c465c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394e736-c281-4d5e-9838-3de8b1fc121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Volume 6ac92f12-f84f-414f-afb2-a92210c0556e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac92f12-f84f-414f-afb2-a92210c0556e', 'volume_size': 1} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1155375967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac92f12-f84f-414f-afb2-a92210c0556e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf9acc21262045da8620ff57c7fb3776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:08Z,use_quota=True,user_id='20c13965810e42c79f7295516dd36d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Creating volume 6ac92f12-f84f-414f-afb2-a92210c0556e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:08 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:08 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e 1073741824 Apr 24 15:34:08 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:08 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.597s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Deleted volume successfully. Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-74014207-eaa4-4ae9-96f1-95085933641d tempest-CinderUnicodeTest-251024747 None] Lock "cinder-045eaf5c-1afc-4e29-bb72-553371530989-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:08 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 0.656s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "cinder-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:08 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:08 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "cinder-quobyte-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2871c7-cc7f-4139-b166-09dc3a0a4e9f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:08 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba Apr 24 15:34:08 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:08 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e 1073741824" returned: 0 in 0.736s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:08 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e Apr 24 15:34:08 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:08 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 1 in 0.598s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:34:08 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Downloaded image 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 22d3959f-4471-4688-bf36-18055d4f3901 successfully. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d for user 6412606d1257420099b9b50ae85010e5 is deleted. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Marking volume 22d3959f-4471-4688-bf36-18055d4f3901 as bootable. {{(pid=81909) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Copying metadata from image 35d86ae8-c267-4804-98fd-3c88f2d8852d to 22d3959f-4471-4688-bf36-18055d4f3901. {{(pid=81909) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Creating volume glance metadata for volume 22d3959f-4471-4688-bf36-18055d4f3901 backed by image 35d86ae8-c267-4804-98fd-3c88f2d8852d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81909) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e13b39-e605-46ef-a9cc-be74ab87e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d3959f-4471-4688-bf36-18055d4f3901', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daa6ab1-a61e-4bfe-8298-a739e6985bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Volume volume-22d3959f-4471-4688-bf36-18055d4f3901 (22d3959f-4471-4688-bf36-18055d4f3901): created successfully Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daa6ab1-a61e-4bfe-8298-a739e6985bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Flow 'volume_create_manager' (27bc7f16-5033-4b73-a2d0-7e4a9ab58c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-19c208b9-4795-4915-adff-1128e973fd2a tempest-VolumesExtendTest-1589188589 None] Created volume successfully. Apr 24 15:34:09 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" returned: 0 in 0.633s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:09 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba Apr 24 15:34:09 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:09 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e" returned: 0 in 0.570s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394e736-c281-4d5e-9838-3de8b1fc121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac92f12-f84f-414f-afb2-a92210c0556e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d12982-f248-47a4-85b6-b8eca1ae9c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Volume volume-6ac92f12-f84f-414f-afb2-a92210c0556e (6ac92f12-f84f-414f-afb2-a92210c0556e): created successfully Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d12982-f248-47a4-85b6-b8eca1ae9c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Flow 'volume_create_manager' (33ea0538-0ef8-428d-be03-af8c2f7051ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-acf1cf1d-7abd-43af-a64a-93f91c96f0c0 req-5ea7e207-a8eb-47da-99c5-f375dc36df8c tempest-VolumesGetTestJSON-49070884 None] Created volume successfully. Apr 24 15:34:09 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" returned: 0 in 0.502s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "cinder-quobyte-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba" released by "delete_volume" :: held 1.173s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Created reservations ['f712a965-d251-4b25-ab4c-c8362d48c2e2', 'c0327e34-6f3f-48fd-b0d7-4c62ad0a31b7', 'aaa52925-988d-4b22-9e83-f0e41984e144', 'fe5eb23f-8542-4cdf-949d-997194bddb34'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:09 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:09 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5904be-cf49-4b3f-94ec-22002ed184b5]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:10 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:10 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:10 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.462s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Deleted volume successfully. Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a534a3-16e1-4eeb-8253-b2f185739027 tempest-CinderUnicodeTest-251024747 None] Lock "cinder-2d505fc0-83a8-4d06-8f2b-c72fa08f9aba-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Acquiring lock "cinder-6ac92f12-f84f-414f-afb2-a92210c0556e-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "cinder-6ac92f12-f84f-414f-afb2-a92210c0556e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Acquiring lock "cinder-quobyte-6ac92f12-f84f-414f-afb2-a92210c0556e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "cinder-quobyte-6ac92f12-f84f-414f-afb2-a92210c0556e" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881ec26-f3a1-4c40-b676-5281bd3892b7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:10 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e Apr 24 15:34:10 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:10 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:10 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:10 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:11 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e" returned: 0 in 0.624s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:11 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e Apr 24 15:34:11 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:11 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 1 in 0.598s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 2G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 2G" returned: 0 in 0.093s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.358s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-72703e54-c6ba-4be9-b436-4da91a0bcb72 tempest-VolumesExtendTest-1589188589 None] Extend volume completed successfully. Apr 24 15:34:11 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ac92f12-f84f-414f-afb2-a92210c0556e" returned: 0 in 0.533s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "cinder-quobyte-6ac92f12-f84f-414f-afb2-a92210c0556e" released by "delete_volume" :: held 1.204s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG cinder.quota [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Created reservations ['7032e9b7-3a43-49dc-a32d-b961702a0c3b', 'b5458abf-1cf0-4adf-b717-700a8a8247a4', '29cf9483-51fd-4a27-a793-0c5f831900e7', '2625b074-f43f-44ca-8ba1-7e9bc657caeb'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:11 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:11 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:12 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.510s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.manager [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:12 devstack cinder-volume[81909]: INFO cinder.volume.manager [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Deleted volume successfully. Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [req-b15e0d0d-3738-4f5a-8200-eecfa1b3ffb1 req-951ac023-503c-470c-a45b-0210cd1b6869 tempest-VolumesGetTestJSON-49070884 None] Lock "cinder-6ac92f12-f84f-414f-afb2-a92210c0556e-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-22d3959f-4471-4688-bf36-18055d4f3901-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "cinder-22d3959f-4471-4688-bf36-18055d4f3901-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-quobyte-22d3959f-4471-4688-bf36-18055d4f3901" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-22d3959f-4471-4688-bf36-18055d4f3901" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e735f5-4c6f-4dc3-b35d-9a0713b474d6]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:12 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:12 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:13 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 0.767s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:13 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:13 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:14 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 1 in 0.684s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:14 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901 Apr 24 15:34:14 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:14 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-22d3959f-4471-4688-bf36-18055d4f3901" returned: 0 in 0.615s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-22d3959f-4471-4688-bf36-18055d4f3901" released by "delete_volume" :: held 2.134s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Created reservations ['5a91e508-803b-4e41-8124-1c0789d34b67', 'ba246ff7-dfd2-44a3-ad98-76d234eac95e', 'd6a3c000-3323-48c3-8feb-077bf7360b34', '976486f8-fe78-4c6e-aed6-fe794788d966'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:14 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:14 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:15 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.505s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:15 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:15 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Deleted volume successfully. Apr 24 15:34:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6da6fa2a-5716-42d8-9d55-b33fcaff268f tempest-VolumesExtendTest-1589188589 None] Lock "cinder-22d3959f-4471-4688-bf36-18055d4f3901-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Flow 'volume_create_manager' (1f37f117-0b10-4900-bd51-8411dd2473a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98af131a-2087-4004-990b-e81c8cf125fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98af131a-2087-4004-990b-e81c8cf125fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1982847877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2805fc0-de08-4484-b78e-c430ad7e4024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a3fa5eaf9d4c8a94543ed9a255166a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:16Z,use_quota=True,user_id='6412606d1257420099b9b50ae85010e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1d7f6a-4b6c-4a69-8cb2-f56e8d3c988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1d7f6a-4b6c-4a69-8cb2-f56e8d3c988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df117cd8-a4e1-4dab-ae25-60aee3b07167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df117cd8-a4e1-4dab-ae25-60aee3b07167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2805fc0-de08-4484-b78e-c430ad7e4024', 'volume_name': 'volume-f2805fc0-de08-4484-b78e-c430ad7e4024', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbcdae7-2db0-452f-afc1-ceb17b9e889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbcdae7-2db0-452f-afc1-ceb17b9e889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c2b717-5abd-44cc-a575-d67b20609d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:16 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Volume f2805fc0-de08-4484-b78e-c430ad7e4024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2805fc0-de08-4484-b78e-c430ad7e4024', 'volume_size': 1} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1982847877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2805fc0-de08-4484-b78e-c430ad7e4024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a3fa5eaf9d4c8a94543ed9a255166a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:16Z,use_quota=True,user_id='6412606d1257420099b9b50ae85010e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Creating volume f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:16 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:16 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 1073741824 Apr 24 15:34:16 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:17 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 1073741824" returned: 0 in 0.745s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:17 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:17 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:17 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c2b717-5abd-44cc-a575-d67b20609d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2805fc0-de08-4484-b78e-c430ad7e4024', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9298a8-0943-42aa-b295-67dba4a36c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:17 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Volume volume-f2805fc0-de08-4484-b78e-c430ad7e4024 (f2805fc0-de08-4484-b78e-c430ad7e4024): created successfully Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9298a8-0943-42aa-b295-67dba4a36c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Flow 'volume_create_manager' (1f37f117-0b10-4900-bd51-8411dd2473a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:17 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b6575e5c-f056-43d2-a910-f38ba3aeb13c tempest-VolumesExtendTest-1589188589 None] Created volume successfully. Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Creating offline snapshot 0d7476a3-72bd-447f-8995-27974201a8c5 of volume f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cba48e4-1046-4a20-ae32-820595e0258a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-db6fac52-8edf-4180-9ed7-ceb0fd250856 tempest-BackendsCapabilitiesAdminTestsJSON-2077056115 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309799194336, 'free_capacity_gb': 1775.7309799194336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81909) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 15:34:18 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:18 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-75e93e46-625b-4ad6-858e-4b9b20a827f5 tempest-BackendsCapabilitiesAdminTestsJSON-2077056115 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309799194336, 'free_capacity_gb': 1775.7309799194336, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81909) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 15:34:19 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 0.620s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:19 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 1G Apr 24 15:34:19 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:20 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 1G" returned: 0 in 0.785s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2805fc0-de08-4484-b78e-c430ad7e4024 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:20 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2805fc0-de08-4484-b78e-c430ad7e4024 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 Apr 24 15:34:20 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:20 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2805fc0-de08-4484-b78e-c430ad7e4024 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5" returned: 0 in 0.662s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:20 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 is being set with open permissions: ugo+rw Apr 24 15:34:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:20 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 Apr 24 15:34:20 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:21 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5" returned: 0 in 0.710s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:21 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=130,cinder:UPDATE=164,cinder:INSERT=54,cinder:DELETE=14 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:34:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:21 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info Apr 24 15:34:21 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:22 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info" returned: 0 in 0.872s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:22 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info is being set with open permissions: ugo+rw Apr 24 15:34:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:22 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info Apr 24 15:34:22 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:23 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.info" returned: 0 in 0.830s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.611s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-01227ef2-47a4-4802-ac14-5d9aeb72fac4 tempest-VolumesExtendTest-1589188589 None] Create snapshot completed successfully Apr 24 15:34:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:24 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f253f-31c0-47b9-9138-7609d7e82724]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:24 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:24 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a04ae9f6-7e48-4927-b9a2-5f1ae0f0a54c tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" by "attach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a04ae9f6-7e48-4927-b9a2-5f1ae0f0a54c tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" acquired by "attach_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:25 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 1.410s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 2G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a04ae9f6-7e48-4927-b9a2-5f1ae0f0a54c tempest-VolumesActionsTest-1706277182 None] Attaching volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a to instance 0d697294-484a-4d90-b2ae-da5e26265bda at mountpoint /dev/vdb on host None. Apr 24 15:34:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a04ae9f6-7e48-4927-b9a2-5f1ae0f0a54c tempest-VolumesActionsTest-1706277182 None] Attach volume completed successfully. Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a04ae9f6-7e48-4927-b9a2-5f1ae0f0a54c tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" released by "attach_volume" :: held 0.226s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 2G" returned: 0 in 0.228s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.692s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e75c392c-be57-45c1-93f1-ec12f7703b26 tempest-VolumesExtendTest-1589188589 None] Extend volume completed successfully. Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-930efd83-bc51-4dfd-b2be-5fd01a63e0d1 tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" by "detach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-930efd83-bc51-4dfd-b2be-5fd01a63e0d1 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-930efd83-bc51-4dfd-b2be-5fd01a63e0d1 tempest-VolumesActionsTest-1706277182 None] Detaching volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a from instance 0d697294-484a-4d90-b2ae-da5e26265bda. Apr 24 15:34:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-930efd83-bc51-4dfd-b2be-5fd01a63e0d1 tempest-VolumesActionsTest-1706277182 None] Detach volume completed successfully. Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-930efd83-bc51-4dfd-b2be-5fd01a63e0d1 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-0d7476a3-72bd-447f-8995-27974201a8c5-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-0d7476a3-72bd-447f-8995-27974201a8c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-quobyte-0d7476a3-72bd-447f-8995-27974201a8c5" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-0d7476a3-72bd-447f-8995-27974201a8c5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Deleting offline snapshot 0d7476a3-72bd-447f-8995-27974201a8c5 of volume f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] snapshot_file for this snap is: volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1418650b-f3b4-4e53-bdf2-6ad99bcfe6e5]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:27 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 Apr 24 15:34:27 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:28 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5" returned: 0 in 1.178s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2805fc0-de08-4484-b78e-c430ad7e4024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:34:28 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1980c9bc-6b48-42a2-9b5e-af27fdd7bfff]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b3af2599-7269-45e9-8d7c-b9511e583486 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-397755126: creating Apr 24 15:34:28 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:28 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b3af2599-7269-45e9-8d7c-b9511e583486 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-397755126: created successfully Apr 24 15:34:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b3af2599-7269-45e9-8d7c-b9511e583486 tempest-GroupSnapshotsTest-2971181 None] Create group completed successfully. Apr 24 15:34:29 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 0.862s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:29 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 Apr 24 15:34:29 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:29 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5" returned: 0 in 0.746s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:29 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5 Apr 24 15:34:29 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (40581ddf-1f58-4799-b112-8d5c09668b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb0342e-bc2b-4cee-b697-b7e717b373e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb0342e-bc2b-4cee-b697-b7e717b373e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166341448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d249955c-ee57-4c11-8128-a89de299aa0f,host='devstack@QuobyteHD#QuobyteHD',id=31cc67dc-90ad-462d-b8de-9ab5b57e8f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:30Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7471c482-5fa4-471b-8877-eae1b8d8931d),volume_type_id=7471c482-5fa4-471b-8877-eae1b8d8931d)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11bbd7a-b204-4c56-8221-e7f2ec838b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11bbd7a-b204-4c56-8221-e7f2ec838b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687c1920-f058-4374-9019-3c0690de36bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687c1920-f058-4374-9019-3c0690de36bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cc67dc-90ad-462d-b8de-9ab5b57e8f99', 'volume_name': 'volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b9e4bf-4cfe-4ae6-b052-467dfdffd5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b9e4bf-4cfe-4ae6-b052-467dfdffd5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfb0f0e-4564-4a32-9778-5ee8b8f1c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Volume 31cc67dc-90ad-462d-b8de-9ab5b57e8f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99', 'volume_size': 1} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d249955c-ee57-4c11-8128-a89de299aa0f,created_at=2026-04-24T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166341448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d249955c-ee57-4c11-8128-a89de299aa0f,host='devstack@QuobyteHD#QuobyteHD',id=31cc67dc-90ad-462d-b8de-9ab5b57e8f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:30Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7471c482-5fa4-471b-8877-eae1b8d8931d),volume_type_id=7471c482-5fa4-471b-8877-eae1b8d8931d)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Creating volume 31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:30 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:30 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 1073741824 Apr 24 15:34:30 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:30 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024.0d7476a3-72bd-447f-8995-27974201a8c5" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-0d7476a3-72bd-447f-8995-27974201a8c5" released by "_delete_snapshot" :: held 3.470s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" released by "delete_snapshot" :: held 3.505s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Created reservations ['b62adc3e-a397-4761-944f-771c2acf1f89', 'c67c2b4d-50bd-45af-9596-d74b723a0494', '3e3962ed-a211-4c39-bfe1-36102189c7b6', '454bb3e4-2583-460e-9545-ae37158fe76c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Delete snapshot completed successfully. Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d67d5f83-209d-4d23-a49b-c23560283d64 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-0d7476a3-72bd-447f-8995-27974201a8c5-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:30 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 1073741824" returned: 0 in 0.818s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:30 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:30 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-f2805fc0-de08-4484-b78e-c430ad7e4024-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-f2805fc0-de08-4484-b78e-c430ad7e4024-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec46612-7744-49a3-8faf-43e569e9c53e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:31 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:31 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:31 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.533s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfb0f0e-4564-4a32-9778-5ee8b8f1c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463445c-386b-4134-adf4-a58324cfb670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Volume volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 (31cc67dc-90ad-462d-b8de-9ab5b57e8f99): created successfully Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463445c-386b-4134-adf4-a58324cfb670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (40581ddf-1f58-4799-b112-8d5c09668b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-31356971-32e6-4418-80b7-c68e3e144352 tempest-GroupSnapshotsTest-2971181 None] Created volume successfully. Apr 24 15:34:31 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:31 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024 Apr 24 15:34:31 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] GroupSnapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: creating. Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Group snapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: creating. {{(pid=81909) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 15:34:32 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f2805fc0-de08-4484-b78e-c430ad7e4024" returned: 0 in 0.635s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-quobyte-f2805fc0-de08-4484-b78e-c430ad7e4024" released by "delete_volume" :: held 1.277s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Creating offline snapshot 61ba1436-7638-46d0-83d3-0344dae8f77c of volume 31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e8f454-5de9-4303-b829-92b32ea11a3f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Created reservations ['ecdd7eb0-71b7-43c0-8b1f-d4c645cd1404', 'a9e9e09a-6f32-43e1-b461-04f0e175b30d', 'a38c252f-f65d-4287-a7f4-cff7ebbbbc93', '4b56b5b0-4298-42b9-ab5f-6c25fbadc481'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:32 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:32 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:32 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:32 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:33 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.532s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:33 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Deleted volume successfully. Apr 24 15:34:33 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.675s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fdf767fa-5a3e-49a2-b15d-6b35c94d9874 tempest-VolumesExtendTest-1589188589 None] Lock "cinder-f2805fc0-de08-4484-b78e-c430ad7e4024-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:33 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c 1G Apr 24 15:34:33 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:34 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c 1G" returned: 0 in 0.824s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:34 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:34 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:34 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 0.630s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:34 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:34:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:34 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:34 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:35 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 0.688s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:35 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info Apr 24 15:34:35 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:36 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info" returned: 0 in 0.674s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:36 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:36 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info Apr 24 15:34:36 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:36 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.info" returned: 0 in 0.635s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.251s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (0a64fd9f-14cc-4887-bc92-60f797fa91a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f36d64-6b28-486f-9eca-a9652ce824c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f36d64-6b28-486f-9eca-a9652ce824c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-406406816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bb64fd-f001-4973-aecc-c7c68999d010,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:37Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecab7bc0-1b2e-4793-9cab-29d62dc85547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecab7bc0-1b2e-4793-9cab-29d62dc85547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e17e255-863f-4880-bfa1-0a7e6f131552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e17e255-863f-4880-bfa1-0a7e6f131552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bb64fd-f001-4973-aecc-c7c68999d010', 'volume_name': 'volume-09bb64fd-f001-4973-aecc-c7c68999d010', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64a3c33-9862-48e3-ac11-190b8c8aba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64a3c33-9862-48e3-ac11-190b8c8aba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b52e81-c28f-4718-a31b-32c496779d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Volume 09bb64fd-f001-4973-aecc-c7c68999d010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bb64fd-f001-4973-aecc-c7c68999d010', 'volume_size': 1} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-406406816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bb64fd-f001-4973-aecc-c7c68999d010,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:37Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Creating volume 09bb64fd-f001-4973-aecc-c7c68999d010 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:36 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:36 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 1073741824 Apr 24 15:34:36 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5c94c243-a599-4757-89ab-ccdeda26f067 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: created successfully Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Flow 'volume_create_manager' (08370aea-5183-49ab-81b1-072bd79edcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064f8e90-2956-4ea2-baa5-96a94be7936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064f8e90-2956-4ea2-baa5-96a94be7936e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1693335919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206907e-50f0-4f9b-9cf5-a68e4c0f9580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e32773f1a24a6ca223a6507142d84c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:37Z,use_quota=True,user_id='d2e195778b4b4568b6b710272a13f724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e00cb18-a122-43e3-ad87-4acdc45f88b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e00cb18-a122-43e3-ad87-4acdc45f88b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5f5749-c173-4a18-a91f-5b88832a5b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5f5749-c173-4a18-a91f-5b88832a5b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1206907e-50f0-4f9b-9cf5-a68e4c0f9580', 'volume_name': 'volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a0b1b5-3c1c-4003-bc71-9002bab25383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a0b1b5-3c1c-4003-bc71-9002bab25383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a42e5d-8353-4876-868e-a657a0bad5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:37 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Volume 1206907e-50f0-4f9b-9cf5-a68e4c0f9580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580', 'volume_size': 1} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:37 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 1073741824" returned: 0 in 0.713s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:37 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 Apr 24 15:34:37 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:38 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010" returned: 0 in 0.504s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1693335919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206907e-50f0-4f9b-9cf5-a68e4c0f9580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e32773f1a24a6ca223a6507142d84c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:37Z,use_quota=True,user_id='d2e195778b4b4568b6b710272a13f724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Creating volume 1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:38 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b52e81-c28f-4718-a31b-32c496779d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bb64fd-f001-4973-aecc-c7c68999d010', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:38 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 1073741824 Apr 24 15:34:38 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3040b18c-cb3b-4192-a7ba-651461c35beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Volume volume-09bb64fd-f001-4973-aecc-c7c68999d010 (09bb64fd-f001-4973-aecc-c7c68999d010): created successfully Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3040b18c-cb3b-4192-a7ba-651461c35beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (0a64fd9f-14cc-4887-bc92-60f797fa91a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7a5daf83-6916-4674-aa03-68cf5b1825f3 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:38 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 1073741824" returned: 0 in 0.743s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:39 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:34:39 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (2dde3765-2c32-42e8-9b5b-7cc6a114fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:39 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36061fde-d409-4990-876b-7605b040561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.650s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c-0fbfa3e9-1449-4325-9780-9af02c071e15" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36061fde-d409-4990-876b-7605b040561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1655882354',display_name='tempest-VolumesGetTest-Volume-843289188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06576849-3d5a-400d-a4df-e25e2df814b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:39Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4d1025-6c36-4346-b60a-6abe0ea93224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4d1025-6c36-4346-b60a-6abe0ea93224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9b8887-eea4-4ef4-85f4-b508b162f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9b8887-eea4-4ef4-85f4-b508b162f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06576849-3d5a-400d-a4df-e25e2df814b9', 'volume_name': 'volume-06576849-3d5a-400d-a4df-e25e2df814b9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc00db33-6dee-4a42-9589-8369f9840703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc00db33-6dee-4a42-9589-8369f9840703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f5266-2998-4f81-b870-b41a76b43d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Volume 06576849-3d5a-400d-a4df-e25e2df814b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06576849-3d5a-400d-a4df-e25e2df814b9', 'volume_size': 1} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a42e5d-8353-4876-868e-a657a0bad5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35529632-6d4d-4f20-b43d-084e78074bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:39 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Volume volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 (1206907e-50f0-4f9b-9cf5-a68e4c0f9580): created successfully Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35529632-6d4d-4f20-b43d-084e78074bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Flow 'volume_create_manager' (08370aea-5183-49ab-81b1-072bd79edcb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c-0fbfa3e9-1449-4325-9780-9af02c071e15" acquired by "_create_volume_from_snapshot" :: waited 0.084s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Creating volume 0fbfa3e9-1449-4325-9780-9af02c071e15 from snapshot 61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1237e70a-90f4-4c79-893a-2d3a105f4631 tempest-SnapshotDependencyTests-1117399664 None] Created volume successfully. Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] snapshot: 61ba1436-7638-46d0-83d3-0344dae8f77c, volume: 0fbfa3e9-1449-4325-9780-9af02c071e15, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca35b47d-8f8a-4812-9c37-c3041375362c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:39 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:39 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:40 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 0.599s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fb2ba-64d0-417b-a0b4-d3a8e7da28fe]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:40 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:40 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:40 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.581s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:34:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:40 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 Apr 24 15:34:40 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:46 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15" returned: 0 in 5.758s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec17d43-2ba0-4d70-8bfe-bcafa3c6ad2f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:46 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:46 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:47 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.698s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:34:47 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Converted 1024.00 MB image at 177.79 MB/s Apr 24 15:34:47 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:47 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 Apr 24 15:34:47 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:47 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15" returned: 0 in 0.446s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" released by "_copy_volume_from_snapshot" :: held 8.182s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c-0fbfa3e9-1449-4325-9780-9af02c071e15" released by "_create_volume_from_snapshot" :: held 8.223s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.310s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.275s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1655882354',display_name='tempest-VolumesGetTest-Volume-843289188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06576849-3d5a-400d-a4df-e25e2df814b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:39Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Creating volume 06576849-3d5a-400d-a4df-e25e2df814b9 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:47 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:47 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 1073741824 Apr 24 15:34:47 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:47 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-242753a8-76c3-4206-a780-54304b17ea65 tempest-GroupSnapshotsTest-2971181 None] Create group from source-snapshot-2e5ff68a-785e-49b8-8970-296831a39c2b completed successfully. Apr 24 15:34:48 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 1073741824" returned: 0 in 0.663s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:48 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 Apr 24 15:34:48 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[69430638-f9ec-4d62-9efd-5c8815539f81]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:48 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 Apr 24 15:34:48 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:49 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9" returned: 0 in 0.520s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.584s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:49 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:49 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f5266-2998-4f81-b870-b41a76b43d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06576849-3d5a-400d-a4df-e25e2df814b9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927a2c46-4f77-4984-bb32-23d5ca75c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Creating offline snapshot 006fbb06-3674-4eca-a149-aa03e7f92b27 of volume 1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:34:49 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Volume volume-06576849-3d5a-400d-a4df-e25e2df814b9 (06576849-3d5a-400d-a4df-e25e2df814b9): created successfully Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927a2c46-4f77-4984-bb32-23d5ca75c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (2dde3765-2c32-42e8-9b5b-7cc6a114fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0536b967-615f-430f-9088-8041a72261c4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6d39779c-1823-4fc7-8260-8e6aa1fd16f3 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:34:49 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:49 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:34:49 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:49 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15 Apr 24 15:34:49 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:49 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.603s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-06576849-3d5a-400d-a4df-e25e2df814b9-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "cinder-06576849-3d5a-400d-a4df-e25e2df814b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:49 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0fbfa3e9-1449-4325-9780-9af02c071e15" returned: 0 in 0.689s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-06576849-3d5a-400d-a4df-e25e2df814b9" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0fbfa3e9-1449-4325-9780-9af02c071e15" released by "delete_volume" :: held 1.395s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-06576849-3d5a-400d-a4df-e25e2df814b9" acquired by "delete_volume" :: waited 0.064s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[65097dbd-89cf-4af7-81f5-e81278246adc]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Created reservations ['b5c4899b-3627-4d1b-aa75-51086594f62b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:50 devstack cinder-volume[81909]: WARNING cinder.quota [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-842167416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-842167416, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:34:50 devstack cinder-volume[81909]: WARNING cinder.quota [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-842167416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-842167416, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Created reservations ['5cbd6c2d-e985-42d9-8f89-4b66fb2fdffb', '9e3dcfbf-4810-48fd-8a1f-18c2c2848a63', '1e75fe8d-e028-4551-8d15-aaa0e3229e53', '5e08c86b-e0cd-49fd-b6cb-312ce5d5bd34'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:50 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 Apr 24 15:34:50 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:50 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 1.239s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:50 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:50 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:50 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 1G Apr 24 15:34:50 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: deleting Apr 24 15:34:51 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: deleting {{(pid=81909) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9" returned: 0 in 0.899s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:51 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9 Apr 24 15:34:51 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" acquired by "delete_snapshot" :: waited 0.096s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:51 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.825s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9f5d57df-ef0c-4b03-9ae6-c41880d639dd tempest-GroupSnapshotsTest-2971181 None] Delete group completed successfully. Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Deleting offline snapshot 61ba1436-7638-46d0-83d3-0344dae8f77c of volume 31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] snapshot_file for this snap is: volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b032b-0447-4099-93f4-3b181523bcb3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:51 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 1G" returned: 0 in 0.997s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:51 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:34:51 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:51 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:51 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:51 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-06576849-3d5a-400d-a4df-e25e2df814b9" returned: 0 in 0.732s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-06576849-3d5a-400d-a4df-e25e2df814b9" released by "delete_volume" :: held 1.755s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Created reservations ['407c498a-4640-4d9b-a2f8-b2d86dd85d99', '3d7160eb-26d4-4e1c-899d-ad257173a73c', 'da50724c-a10e-4e9c-8b4f-4912d42bb7ac', 'fc3cf8ae-c322-4b2e-80a1-abbd253381e8'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:52 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:52 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:52 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.999s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:52 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 is being set with open permissions: ugo+rw Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-09bb64fd-f001-4973-aecc-c7c68999d010-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "cinder-09bb64fd-f001-4973-aecc-c7c68999d010-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:52 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:34:52 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-09bb64fd-f001-4973-aecc-c7c68999d010" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-09bb64fd-f001-4973-aecc-c7c68999d010" acquired by "delete_volume" :: waited 0.029s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47d634-8f9f-4500-9875-ec5df9a7b8b3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:52 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 1.504s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b0124-5499-4376-826a-02f77465a376]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:52 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 Apr 24 15:34:52 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:53 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:53 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:53 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.609s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:53 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.936s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:34:53 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbd76837-2d18-4f07-b60a-51e5546dadec tempest-VolumesGetTest-1668668084 None] Lock "cinder-06576849-3d5a-400d-a4df-e25e2df814b9-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:53 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc7e1c29-ded4-4366-93fe-ee2e750ad5f3 tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" by "attach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc7e1c29-ded4-4366-93fe-ee2e750ad5f3 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" acquired by "attach_volume" :: waited 0.041s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fc7e1c29-ded4-4366-93fe-ee2e750ad5f3 tempest-VolumesActionsTest-1706277182 None] Attaching volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a to instance 903e35ea-54bb-4424-a109-46059ddcd398 at mountpoint /dev/vdb on host None. Apr 24 15:34:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fc7e1c29-ded4-4366-93fe-ee2e750ad5f3 tempest-VolumesActionsTest-1706277182 None] Attach volume completed successfully. Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc7e1c29-ded4-4366-93fe-ee2e750ad5f3 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" released by "attach_volume" :: held 0.160s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:53 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010" returned: 0 in 0.938s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:53 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010 Apr 24 15:34:53 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:53 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info" returned: 0 in 0.605s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:53 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info is being set with open permissions: ugo+rw Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:53 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info Apr 24 15:34:53 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:53 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.923s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:53 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:53 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-033a4926-da69-48de-a1c6-d8062fd3cced tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" by "detach_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-033a4926-da69-48de-a1c6-d8062fd3cced tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-033a4926-da69-48de-a1c6-d8062fd3cced tempest-VolumesActionsTest-1706277182 None] Detaching volume 2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a from instance 903e35ea-54bb-4424-a109-46059ddcd398. Apr 24 15:34:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-033a4926-da69-48de-a1c6-d8062fd3cced tempest-VolumesActionsTest-1706277182 None] Detach volume completed successfully. Apr 24 15:34:54 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-033a4926-da69-48de-a1c6-d8062fd3cced tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09bb64fd-f001-4973-aecc-c7c68999d010" returned: 0 in 0.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-09bb64fd-f001-4973-aecc-c7c68999d010" released by "delete_volume" :: held 1.587s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Created reservations ['19227406-27b6-4e92-ab0a-b0add7b84ed0', 'a928703c-51de-42ee-9c00-4dce75a9d519', '48f21ebb-f966-4269-b43d-1599966c97b7', '4d13245b-7c5b-4899-a3d1-6147feba6b1c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:54 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.info" returned: 0 in 0.628s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:54 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:54 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.282s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5b04bbac-41ad-428d-b002-55ca047f36d6 tempest-SnapshotDependencyTests-1117399664 None] Create snapshot completed successfully Apr 24 15:34:54 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 0.679s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:54 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c Apr 24 15:34:54 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:54 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.605s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:34:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-cb5bbc88-7542-4c82-8e05-16cc53a6bc74 tempest-VolumesGetTest-1668668084 None] Lock "cinder-09bb64fd-f001-4973-aecc-c7c68999d010-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:55 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99.61ba1436-7638-46d0-83d3-0344dae8f77c" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-61ba1436-7638-46d0-83d3-0344dae8f77c" released by "_delete_snapshot" :: held 3.824s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" released by "delete_snapshot" :: held 3.909s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:55 devstack cinder-volume[81909]: WARNING cinder.quota [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-842167416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-842167416, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (feb25847-9fe6-4ca8-b64f-bd7de4203550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3643c7-c2cb-4bfc-9622-d59ed98ebe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['0de6fe78-e0e0-449f-b1f0-3f08773d1bc2', '9e82d645-6043-4eda-a054-d80a06996179', 'f76b0f24-44d6-451b-ab8c-251cdcb6484b', 'fc61fceb-09d7-44e0-8b4e-72bb43c9ef07'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3643c7-c2cb-4bfc-9622-d59ed98ebe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1958427955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121ce321-e3a4-43f9-8fa9-c375bcab4a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:55Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6284056-b817-4965-a5f5-778956d8c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6284056-b817-4965-a5f5-778956d8c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f6c7b-0a73-4f59-94aa-27bb78e62a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f6c7b-0a73-4f59-94aa-27bb78e62a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'volume_name': 'volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76ecce5-7b2e-4dfb-bb8b-78c85cd3bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76ecce5-7b2e-4dfb-bb8b-78c85cd3bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4796df2-bc3d-47d0-9e02-169a9d1ad920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:55 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Volume 121ce321-e3a4-43f9-8fa9-c375bcab4a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'volume_size': 1} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1958427955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121ce321-e3a4-43f9-8fa9-c375bcab4a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:55Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Creating volume 121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:55 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:55 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 1073741824 Apr 24 15:34:55 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:55 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5b5fae8a-7fc1-4522-8ac7-b0720c5c3e96 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2e5ff68a-785e-49b8-8970-296831a39c2b: deleted successfully Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=137,cinder:SELECT=128,cinder:INSERT=34,cinder:DELETE=11 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8a218-cfee-4a30-a729-f01021a13b98]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:55 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:55 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Flow 'volume_create_manager' (7528c90c-b82e-43f6-99ce-9bcadf554794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d73f3-6a73-49cf-92dd-d03fdfbe434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d73f3-6a73-49cf-92dd-d03fdfbe434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b98e21-d490-4781-8b58-372797032c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e32773f1a24a6ca223a6507142d84c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=006fbb06-3674-4eca-a149-aa03e7f92b27,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:56Z,use_quota=True,user_id='d2e195778b4b4568b6b710272a13f724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7d39a6-2cc4-4205-84b5-b30351dabf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7d39a6-2cc4-4205-84b5-b30351dabf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e67a545-d2ec-4bb2-9f8e-9eae964561d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e67a545-d2ec-4bb2-9f8e-9eae964561d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09b98e21-d490-4781-8b58-372797032c85', 'volume_name': 'volume-09b98e21-d490-4781-8b58-372797032c85', 'volume_size': 1, 'snapshot_id': '006fbb06-3674-4eca-a149-aa03e7f92b27'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f89c6b-4077-453e-957d-7806b9e5e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f89c6b-4077-453e-957d-7806b9e5e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd102fc0-9034-4768-bd2b-162732c0a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Volume 09b98e21-d490-4781-8b58-372797032c85: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09b98e21-d490-4781-8b58-372797032c85', 'volume_size': 1, 'snapshot_id': '006fbb06-3674-4eca-a149-aa03e7f92b27'} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:56 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 1073741824" returned: 0 in 1.019s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:56 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:34:56 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:56 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.751s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:56 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99 Apr 24 15:34:56 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:56 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.730s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27-09b98e21-d490-4781-8b58-372797032c85" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4796df2-bc3d-47d0-9e02-169a9d1ad920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127d66f2-5e27-414f-a5aa-dcf61b7d8d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27-09b98e21-d490-4781-8b58-372797032c85" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Creating volume 09b98e21-d490-4781-8b58-372797032c85 from snapshot 006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:34:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Volume volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 (121ce321-e3a4-43f9-8fa9-c375bcab4a33): created successfully Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127d66f2-5e27-414f-a5aa-dcf61b7d8d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (feb25847-9fe6-4ca8-b64f-bd7de4203550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] snapshot: 006fbb06-3674-4eca-a149-aa03e7f92b27, volume: 09b98e21-d490-4781-8b58-372797032c85, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:57 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" returned: 0 in 0.500s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d7cea-f1e7-4f8b-81d1-cb4dfddf4359]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4a8dc0ff-5adc-4a08-be97-7717e8b9ab20 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-31cc67dc-90ad-462d-b8de-9ab5b57e8f99" released by "delete_volume" :: held 1.374s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:34:57 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:34:57 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['c270543a-9172-4fac-8565-52512f2792cb'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:57 devstack cinder-volume[81909]: WARNING cinder.db.sqlalchemy.api [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-842167416'] Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['26086341-100c-46e2-99c7-0b4607f57a74', 'e0d09353-b764-4b07-b863-aa39cf1b1c23', '591a9b2c-02ff-4ac2-9038-fa077230abd0', 'f800d6e8-5f16-4220-acc3-26051ac024ea'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:57 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:34:57 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:57 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.608s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ba227-5e30-49dd-a312-c50b7f1892d2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:57 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:34:57 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:34:57 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.622s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:34:57 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:34:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-69ba65cc-f439-436b-8bbb-384b3ae85840 tempest-GroupSnapshotsTest-2971181 None] Delete group completed successfully. Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (4a0a6fe3-0061-499e-a102-56b6898efb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae658f88-f3be-47cf-b596-41cca39d5e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae658f88-f3be-47cf-b596-41cca39d5e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1141612095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0020365d-6bd1-4b17-8d0b-9a738095c473,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=121ce321-e3a4-43f9-8fa9-c375bcab4a33,status='creating',terminated_at=None,updated_at=2026-04-24T13:34:58Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f2bf9-20df-4413-ae00-9ee4b81c1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f2bf9-20df-4413-ae00-9ee4b81c1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0966642-e451-4be3-91db-a35927aae3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0966642-e451-4be3-91db-a35927aae3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0020365d-6bd1-4b17-8d0b-9a738095c473', 'volume_name': 'volume-0020365d-6bd1-4b17-8d0b-9a738095c473', 'volume_size': 1, 'source_volid': '121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f0aef3-2ad8-43d3-9c76-fdebc96d3a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f0aef3-2ad8-43d3-9c76-fdebc96d3a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94beb40c-939d-445d-b358-987287a3c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:34:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Volume 0020365d-6bd1-4b17-8d0b-9a738095c473: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0020365d-6bd1-4b17-8d0b-9a738095c473', 'volume_size': 1, 'source_volid': '121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'source_volstatus': 'available'} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:34:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b4e0bb33-950f-4855-9cf9-f3da5104f114 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-1574127695: creating Apr 24 15:34:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b4e0bb33-950f-4855-9cf9-f3da5104f114 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-1574127695: created successfully Apr 24 15:34:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b4e0bb33-950f-4855-9cf9-f3da5104f114 tempest-GroupSnapshotsTest-2971181 None] Create group completed successfully. Apr 24 15:34:58 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.804s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:34:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:34:58 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 Apr 24 15:34:58 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (02bb8388-c936-4339-b950-5771591764a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcebb717-d790-4565-b117-ca2480c0e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcebb717-d790-4565-b117-ca2480c0e325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1807755335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,host='devstack@QuobyteHD#QuobyteHD',id=fcc1cca1-5a5a-462e-a544-2f220534640e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:00Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0adbae1-3460-4941-8dc0-bc02f7cdc37a),volume_type_id=c0adbae1-3460-4941-8dc0-bc02f7cdc37a)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77bbc36-8d67-4fa3-8e61-7cedc3b6719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77bbc36-8d67-4fa3-8e61-7cedc3b6719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e62900-2c3e-4af0-9416-b135d452a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e62900-2c3e-4af0-9416-b135d452a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc1cca1-5a5a-462e-a544-2f220534640e', 'volume_name': 'volume-fcc1cca1-5a5a-462e-a544-2f220534640e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd4bbac-7677-4904-9a0a-64d8a3db7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd4bbac-7677-4904-9a0a-64d8a3db7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60a41e0-50c1-4e59-9261-c2ff389490d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:00 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Volume fcc1cca1-5a5a-462e-a544-2f220534640e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc1cca1-5a5a-462e-a544-2f220534640e', 'volume_size': 1} Apr 24 15:35:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:03 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85" returned: 0 in 4.998s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[06454643-2354-4ffc-b8fe-13307a1528ad]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:03 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:35:03 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:04 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.676s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:35:04 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Converted 1024.00 MB image at 204.84 MB/s Apr 24 15:35:04 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 is being set with open permissions: ugo+rw Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:04 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 Apr 24 15:35:04 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:04 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85" returned: 0 in 0.468s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" released by "_copy_volume_from_snapshot" :: held 7.661s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27-09b98e21-d490-4781-8b58-372797032c85" released by "_create_volume_from_snapshot" :: held 7.715s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.739s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.591s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:04 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Cloning volume 121ce321-e3a4-43f9-8fa9-c375bcab4a33 to volume 0020365d-6bd1-4b17-8d0b-9a738095c473 Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd102fc0-9034-4768-bd2b-162732c0a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b98e21-d490-4781-8b58-372797032c85', 'volume_size': 1, 'snapshot_id': '006fbb06-3674-4eca-a149-aa03e7f92b27'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed090564-4aa4-4eec-9ef7-92431d56b4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Creating offline snapshot 56e4b869-7f1f-4636-8aaa-b1990ca008e9 of volume 121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:35:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Volume volume-09b98e21-d490-4781-8b58-372797032c85 (09b98e21-d490-4781-8b58-372797032c85): created successfully Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed090564-4aa4-4eec-9ef7-92431d56b4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Flow 'volume_create_manager' (7528c90c-b82e-43f6-99ce-9bcadf554794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a62a77-00c9-475e-a5dd-2c6416a2106a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a5444be2-503e-4950-89f2-a752a7aad037 tempest-SnapshotDependencyTests-1117399664 None] Created volume successfully. Apr 24 15:35:04 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:04 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-006fbb06-3674-4eca-a149-aa03e7f92b27-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-006fbb06-3674-4eca-a149-aa03e7f92b27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Deleting offline snapshot 006fbb06-3674-4eca-a149-aa03e7f92b27 of volume 1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] snapshot_file for this snap is: volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3261cf96-b374-432b-8836-9a8ef58242e4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:05 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:35:05 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:05 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.562s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:05 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 1G Apr 24 15:35:05 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:05 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.524s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0437b1a-4148-49e6-b0db-d1282e269e56]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:05 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:35:05 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:05 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 1G" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:05 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:05 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:06 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:06 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:35:06 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:06 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.478s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:06 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 is being set with open permissions: ugo+rw Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:06 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:06 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:06 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.542s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:06 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:06 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27 Apr 24 15:35:06 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:06 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info Apr 24 15:35:06 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:07 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580.006fbb06-3674-4eca-a149-aa03e7f92b27" returned: 0 in 0.453s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:07 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info" returned: 0 in 0.456s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:07 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info is being set with open permissions: ugo+rw Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-006fbb06-3674-4eca-a149-aa03e7f92b27" released by "_delete_snapshot" :: held 2.164s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" released by "delete_snapshot" :: held 2.191s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:07 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info Apr 24 15:35:07 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Created reservations ['120f151f-22be-43e5-80d3-f1467797ecaf', 'af80d90a-69ff-49da-9a9e-7deef84230ec', '935dfcbb-8b52-4533-9432-b20daa6c4909', '4ad6ed52-7516-44ad-a688-3e5cfa8d625a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Delete snapshot completed successfully. Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-08160220-7b76-4e8b-be58-9d470ae2ae26 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-006fbb06-3674-4eca-a149-aa03e7f92b27-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:07 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.info" returned: 0 in 0.425s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] snapshot: 56e4b869-7f1f-4636-8aaa-b1990ca008e9, volume: 0020365d-6bd1-4b17-8d0b-9a738095c473, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[702686a4-072d-4b1d-8856-f23263b90ce0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:07 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:07 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-1206907e-50f0-4f9b-9cf5-a68e4c0f9580-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-1206907e-50f0-4f9b-9cf5-a68e4c0f9580-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:08 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.554s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7fdebf-7db3-45c8-aeea-43babc5deb65]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2979f3-f8ed-4aa1-a7fe-7cf672de8087]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:08 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:35:08 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:08 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:08 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:08 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:08 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.531s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:08 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580 Apr 24 15:35:08 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:35:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:08 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 Apr 24 15:35:08 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:09 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" returned: 0 in 0.460s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-1206907e-50f0-4f9b-9cf5-a68e4c0f9580" released by "delete_volume" :: held 1.041s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Created reservations ['8bccac89-d983-43f3-8875-a5ec4869e250', 'c44f8423-56d3-4ea9-9ecc-979d05e92140', 'cb293bb7-331c-48fe-a21b-f5b71fe19296', 'b4286bf9-ea20-495e-8a06-7dd7c585f33e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:09 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:09 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:10 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.939s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Deleted volume successfully. Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-616ae558-2dea-4bd6-a464-9cbfb332f36c tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-1206907e-50f0-4f9b-9cf5-a68e4c0f9580-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-09b98e21-d490-4781-8b58-372797032c85-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-09b98e21-d490-4781-8b58-372797032c85-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[748a5bbe-0004-474b-b596-bed8af81e1fa]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:10 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 Apr 24 15:35:10 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:11 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85" returned: 0 in 0.875s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:11 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85 Apr 24 15:35:11 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:12 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-09b98e21-d490-4781-8b58-372797032c85" returned: 0 in 0.889s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-quobyte-09b98e21-d490-4781-8b58-372797032c85" released by "delete_volume" :: held 1.878s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Created reservations ['0bee8bf7-6ce4-4bb2-b0b2-8005f8906305', 'c09fc668-0e0d-4e14-a6f1-79439437e846', '74051601-ed21-4bca-b1e2-f851e362dc27', '564086b2-f5df-4da1-be9e-eeb5ad52146d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:12 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:12 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:13 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.144s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:13 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:13 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Deleted volume successfully. Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f4ac3d08-81b4-405d-bc91-f37034af2324 tempest-SnapshotDependencyTests-1117399664 None] Lock "cinder-09b98e21-d490-4781-8b58-372797032c85-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:14 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473" returned: 0 in 5.295s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af59e7c-c914-4aba-9006-807679f78389]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:14 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:14 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:14 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.654s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:35:14 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Converted 1024.00 MB image at 193.35 MB/s Apr 24 15:35:14 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 is being set with open permissions: ugo+rw Apr 24 15:35:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:14 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 Apr 24 15:35:14 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:15 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473" returned: 0 in 0.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" released by "_copy_volume_from_snapshot" :: held 7.669s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-56e4b869-7f1f-4636-8aaa-b1990ca008e9" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-56e4b869-7f1f-4636-8aaa-b1990ca008e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Deleting offline snapshot 56e4b869-7f1f-4636-8aaa-b1990ca008e9 of volume 121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] snapshot_file for this snap is: volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d6a62-67ce-4260-b89d-96ebeb280e1c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:15 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:15 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:16 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.609s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e493b-df9f-48fc-a38e-5b7a26dade6c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:16 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:16 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:16 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.592s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:16 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:16 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:17 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.635s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:17 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9 Apr 24 15:35:17 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:17 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33.56e4b869-7f1f-4636-8aaa-b1990ca008e9" returned: 0 in 0.483s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-56e4b869-7f1f-4636-8aaa-b1990ca008e9" released by "_delete_snapshot" :: held 2.412s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.237s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.415s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,created_at=2026-04-24T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1807755335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,host='devstack@QuobyteHD#QuobyteHD',id=fcc1cca1-5a5a-462e-a544-2f220534640e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:00Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0adbae1-3460-4941-8dc0-bc02f7cdc37a),volume_type_id=c0adbae1-3460-4941-8dc0-bc02f7cdc37a)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Creating volume fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:35:17 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:35:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94beb40c-939d-445d-b358-987287a3c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0020365d-6bd1-4b17-8d0b-9a738095c473', 'volume_size': 1, 'source_volid': '121ce321-e3a4-43f9-8fa9-c375bcab4a33', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:18 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e 1073741824 Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337bbc7d-a9bf-4042-9a14-c3a154f7a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:18 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:18 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Volume volume-0020365d-6bd1-4b17-8d0b-9a738095c473 (0020365d-6bd1-4b17-8d0b-9a738095c473): created successfully Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337bbc7d-a9bf-4042-9a14-c3a154f7a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (4a0a6fe3-0061-499e-a102-56b6898efb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-607b8824-bb01-45fd-910d-4ba254d917a5 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:35:18 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e 1073741824" returned: 0 in 0.706s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:18 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e Apr 24 15:35:18 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:19 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (b0a71ceb-4980-4744-9f75-8fe377b288ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d93b55f-bd00-4fd7-8a25-20c80bc6070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 14.665s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d93b55f-bd00-4fd7-8a25-20c80bc6070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892162066',display_name='tempest-VolumesGetTest-Volume-970186088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51362cba-f938-4a91-8edd-742dd0b20a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:19Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29ef70-1218-4fc7-9037-9a988ac664e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29ef70-1218-4fc7-9037-9a988ac664e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746e4971-e516-4769-b48c-eca19205082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746e4971-e516-4769-b48c-eca19205082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51362cba-f938-4a91-8edd-742dd0b20a73', 'volume_name': 'volume-51362cba-f938-4a91-8edd-742dd0b20a73', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a88a8d-d1f7-4053-9df6-fc329b4d5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a88a8d-d1f7-4053-9df6-fc329b4d5afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aefdb0-4fa1-4932-ac4c-aba474b3257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Volume 51362cba-f938-4a91-8edd-742dd0b20a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51362cba-f938-4a91-8edd-742dd0b20a73', 'volume_size': 1} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f19a50-0e4f-4864-82fa-bb65ecc1544c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60a41e0-50c1-4e59-9261-c2ff389490d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc1cca1-5a5a-462e-a544-2f220534640e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fcfdaf-519d-4dda-b318-d3a663b4f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:19 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Volume volume-fcc1cca1-5a5a-462e-a544-2f220534640e (fcc1cca1-5a5a-462e-a544-2f220534640e): created successfully Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fcfdaf-519d-4dda-b318-d3a663b4f521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:19 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (02bb8388-c936-4339-b950-5771591764a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-24ce4a37-285e-4ed6-afa5-2acbd657fff6 tempest-GroupSnapshotsTest-2971181 None] Created volume successfully. Apr 24 15:35:19 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:19 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (d21ad231-b719-416f-9cdf-83f3ef80cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e2b281-e547-48e2-a45a-ffd956d006fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e2b281-e547-48e2-a45a-ffd956d006fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941357148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,host='devstack@QuobyteHD#QuobyteHD',id=b7fedc2b-ff38-471b-9ee4-1d4b96d553a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:20Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0adbae1-3460-4941-8dc0-bc02f7cdc37a),volume_type_id=c0adbae1-3460-4941-8dc0-bc02f7cdc37a)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650e56f9-5fb7-487f-b19b-ea7cf29a6ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650e56f9-5fb7-487f-b19b-ea7cf29a6ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b3a61f-504d-4e40-bd65-34f330d94bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b3a61f-504d-4e40-bd65-34f330d94bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fedc2b-ff38-471b-9ee4-1d4b96d553a7', 'volume_name': 'volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f6301-542d-4d0f-a3c1-e25f30c88b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f6301-542d-4d0f-a3c1-e25f30c88b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cc1da3-0584-4c03-a9ae-a044948d062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Volume b7fedc2b-ff38-471b-9ee4-1d4b96d553a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7', 'volume_size': 1} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:20 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.786s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd79484-5fca-4017-92d9-edeeeccb1947]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:20 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:20 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:20 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.567s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.0edade90-6e97-4c88-807a-b8c4968a8f352nnyf20p.img {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:20 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.0edade90-6e97-4c88-807a-b8c4968a8f352nnyf20p.img Apr 24 15:35:20 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:22 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=115,cinder:UPDATE=136,cinder:INSERT=30,cinder:DELETE=7 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:35:25 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.0edade90-6e97-4c88-807a-b8c4968a8f352nnyf20p.img" returned: 0 in 4.917s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:25 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42e7a05-1708-4251-8509-f50adc5c41f9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:25 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:25 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:26 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.615s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:26 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.0edade90-6e97-4c88-807a-b8c4968a8f352nnyf20p.img {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:35:26 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Converted 1024.00 MB image at 208.22 MB/s Apr 24 15:35:26 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] 0edade90-6e97-4c88-807a-b8c4968a8f35 was raw, no need to convert to raw {{(pid=81909) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 15:35:36 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=1 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:35:36 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=49,cinder:UPDATE=40,cinder:INSERT=14,cinder:DELETE=3 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.509s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Uploaded volume to glance image-id: 0edade90-6e97-4c88-807a-b8c4968a8f35. {{(pid=81909) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.458s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892162066',display_name='tempest-VolumesGetTest-Volume-970186088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51362cba-f938-4a91-8edd-742dd0b20a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:19Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Creating volume 51362cba-f938-4a91-8edd-742dd0b20a73 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:35:41 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:35:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:41 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 1073741824 Apr 24 15:35:41 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:41 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1571b083-58ca-47ea-8f08-f4ef62396e7a tempest-VolumesActionsTest-1706277182 None] Copy volume to image completed successfully. Apr 24 15:35:42 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 1073741824" returned: 0 in 0.604s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:42 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 Apr 24 15:35:42 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:42 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73" returned: 0 in 0.432s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.754s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,created_at=2026-04-24T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941357148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68c9768d-4d0b-4f52-9937-7ed46b17d01f,host='devstack@QuobyteHD#QuobyteHD',id=b7fedc2b-ff38-471b-9ee4-1d4b96d553a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:20Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0adbae1-3460-4941-8dc0-bc02f7cdc37a),volume_type_id=c0adbae1-3460-4941-8dc0-bc02f7cdc37a)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Creating volume b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:35:42 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:42 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 1073741824 Apr 24 15:35:42 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aefdb0-4fa1-4932-ac4c-aba474b3257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51362cba-f938-4a91-8edd-742dd0b20a73', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd684fd4-bb22-4430-995a-445b914bc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:42 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Volume volume-51362cba-f938-4a91-8edd-742dd0b20a73 (51362cba-f938-4a91-8edd-742dd0b20a73): created successfully Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd684fd4-bb22-4430-995a-445b914bc708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (b0a71ceb-4980-4744-9f75-8fe377b288ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a896d65e-ffe8-4f1a-b467-bcbd12a7c508 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:35:43 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 1073741824" returned: 0 in 0.589s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:43 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 Apr 24 15:35:43 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:43 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" returned: 0 in 0.424s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.156s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-51362cba-f938-4a91-8edd-742dd0b20a73-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1712731-ea6d-4477-9a7e-ac2082247f59]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cc1da3-0584-4c03-a9ae-a044948d062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573e877-9544-4c91-9842-91c3bae2edac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "cinder-51362cba-f938-4a91-8edd-742dd0b20a73-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:44 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Volume volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 (b7fedc2b-ff38-471b-9ee4-1d4b96d553a7): created successfully Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573e877-9544-4c91-9842-91c3bae2edac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (d21ad231-b719-416f-9cdf-83f3ef80cada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c876ddc1-5cc9-4554-9772-b36b12736e5c tempest-GroupSnapshotsTest-2971181 None] Created volume successfully. Apr 24 15:35:44 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:44 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-51362cba-f938-4a91-8edd-742dd0b20a73" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-51362cba-f938-4a91-8edd-742dd0b20a73" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b7250-7ead-486b-b373-16bfc751ff24]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:44 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 Apr 24 15:35:44 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-92087331-9ed5-41ad-944f-80ab6a1de8da tempest-GroupSnapshotsTest-2971181 None] Update group completed successfully. Apr 24 15:35:44 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f65ec-f9ea-476a-9f0e-bd420f0a4955]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:44 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:44 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:44 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73" returned: 0 in 0.566s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:44 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73 Apr 24 15:35:44 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:45 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:45 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img Apr 24 15:35:45 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:45 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51362cba-f938-4a91-8edd-742dd0b20a73" returned: 0 in 0.425s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-51362cba-f938-4a91-8edd-742dd0b20a73" released by "delete_volume" :: held 1.026s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Created reservations ['cd367f29-7b42-4b23-93d2-04d75e197cde', 'e3a618db-8865-4a5e-89af-e62c39168149', 'eab466bb-da80-459f-8856-833890fafd5c', '0e58b4e6-bd92-4885-8f0f-ddeac4eb4537'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:45 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:45 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a350e73a-0099-463a-8b83-32439fc26e26 tempest-GroupSnapshotsTest-2971181 None] Update group completed successfully. Apr 24 15:35:45 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.650s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:35:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c40b4204-346f-4696-ba3f-2c6b253f459f tempest-VolumesGetTest-1668668084 None] Lock "cinder-51362cba-f938-4a91-8edd-742dd0b20a73-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-0020365d-6bd1-4b17-8d0b-9a738095c473-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "cinder-0020365d-6bd1-4b17-8d0b-9a738095c473-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fade792-f0fc-42a6-b315-06d1e5711ad5]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:46 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 Apr 24 15:35:46 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-592b86de-caf7-4c37-b6b3-62117cee582d tempest-GroupSnapshotsTest-2971181 None] Update group completed successfully. Apr 24 15:35:47 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473" returned: 0 in 1.203s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:47 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473 Apr 24 15:35:47 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-badde524-b2bf-4394-9ec0-f916974d3b8a tempest-GroupSnapshotsTest-2971181 None] Update group completed successfully. Apr 24 15:35:48 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0020365d-6bd1-4b17-8d0b-9a738095c473" returned: 0 in 0.733s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0020365d-6bd1-4b17-8d0b-9a738095c473" released by "delete_volume" :: held 2.029s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Created reservations ['d2e9bc39-ba2c-45c5-94b8-7e900bb6f62f', '5b8e6597-c5d3-4321-81de-b0a7dda29ed2', '8d9c88fa-b8b3-4ee8-8f9a-5e0ebe6cb914', 'afb51647-d38a-4dd9-b418-f47523a6ed55'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:48 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:48 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-121ce321-e3a4-43f9-8fa9-c375bcab4a33-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "cinder-121ce321-e3a4-43f9-8fa9-c375bcab4a33-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:49 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:49 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-121ce321-e3a4-43f9-8fa9-c375bcab4a33" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-121ce321-e3a4-43f9-8fa9-c375bcab4a33" acquired by "delete_volume" :: waited 0.056s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[88336f9c-37c7-484a-b9b6-390a9c8540ed]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:49 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:49 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:49 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.150s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:35:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9467ac94-3607-4f28-a91c-92f62c94267a tempest-VolumesGetTest-1668668084 None] Lock "cinder-0020365d-6bd1-4b17-8d0b-9a738095c473-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] GroupSnapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: creating. Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Group snapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: creating. {{(pid=81909) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:50 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img" returned: 0 in 5.218s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c2f52-a8be-4340-bd47-0b2c1c3d2918]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:50 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.123s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:50 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:50 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:50 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 1.054s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:50 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33 Apr 24 15:35:50 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:50 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-121ce321-e3a4-43f9-8fa9-c375bcab4a33" returned: 0 in 0.427s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:50 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.615s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:35:50 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Converted 1024.00 MB image at 196.17 MB/s Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-121ce321-e3a4-43f9-8fa9-c375bcab4a33" released by "delete_volume" :: held 1.610s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] 3cad7376-5f3e-4c09-8838-08ca87be3fed was raw, converting to qcow2 {{(pid=81909) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b9855-f440-42ad-95da-e194860a0d2a]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Created reservations ['b468b806-c8ef-46c7-b385-a29c6c3cc4bf', 'b52e6a32-0219-494e-9b2c-a570999bb6ec', '2f000692-e634-4e2f-afc1-7ce141155a53', '34654031-f7c3-4e60-9fb9-3df35f80487d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:51 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img Apr 24 15:35:51 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:51 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:51 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:51 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:51 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.474s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-87803f39-ff48-4821-acb6-f4ad45413317 tempest-VolumesGetTest-1668668084 None] Lock "cinder-121ce321-e3a4-43f9-8fa9-c375bcab4a33-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:51 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img Apr 24 15:35:51 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (7eff931c-5996-431d-b31c-41e637559716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793099f1-fae0-423c-8555-08de8d7b9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793099f1-fae0-423c-8555-08de8d7b9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-827860081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:52Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ed4d77-8e4f-4de7-abc3-42c986f083a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ed4d77-8e4f-4de7-abc3-42c986f083a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2883923-adce-4382-9745-4b060ae6adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG cinder.image.glance [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Creating Keystone auth plugin from conf {{(pid=81909) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 15:35:51 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img" returned: 1 in 0.509s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:35:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:51 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4 Apr 24 15:35:51 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2883923-adce-4382-9745-4b060ae6adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e', 'volume_name': 'volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54924a36-1c4d-43bb-8040-8d50c891cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54924a36-1c4d-43bb-8040-8d50c891cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a223f4-52f0-4549-b4f0-bc56651af501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:35:52 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Trying to clone 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e from image 35d86ae8-c267-4804-98fd-3c88f2d8852d at location (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]). {{(pid=81909) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 15:35:52 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Image download 20.69 MB at 20.69 MB/s Apr 24 15:35:52 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4" returned: 0 in 0.486s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Image conversion details: src /opt/stack/data/cinder/conversion/2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a.temp_image.3cad7376-5f3e-4c09-8838-08ca87be3fedis3madzm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:35:52 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ae7ff-00cd-41a1-a6d6-ff61e70446cc]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[afccb2c9-a750-4f58-aa23-141e3bf3c90c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:52 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4 Apr 24 15:35:52 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:52 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD Apr 24 15:35:52 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:52 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qm8uzoy4" returned: 0 in 0.468s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:52 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:52 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d is fetched for user a24865fc6fb8498b88aa4faa232a3633. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 15:35:53 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c042976-aec3-4d4e-b70b-df0863446012]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:53 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD Apr 24 15:35:53 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:53 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.132s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Uploaded volume to glance image-id: 3cad7376-5f3e-4c09-8838-08ca87be3fed. {{(pid=81909) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.860s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Creating offline snapshot 0a786578-87b1-45d8-82f1-e95edbe17e21 of volume fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:35:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1c3d266a-d10d-4fb3-87bb-80ae89e0b20a tempest-VolumesActionsTest-1706277182 None] Copy volume to image completed successfully. Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202545d-d0f9-419c-9590-35e9fe7fed36]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:54 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e Apr 24 15:35:54 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:54 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e" returned: 0 in 0.563s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:54 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 1G Apr 24 15:35:54 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Acquiring lock "cinder-quobyte-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-quobyte-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d629d3-96a3-4da4-ae5b-2dd28de9e5a2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:54 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:54 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:55 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 1G" returned: 0 in 0.608s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc1cca1-5a5a-462e-a544-2f220534640e -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:55 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc1cca1-5a5a-462e-a544-2f220534640e -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 Apr 24 15:35:55 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:55 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:55 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a Apr 24 15:35:55 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:55 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc1cca1-5a5a-462e-a544-2f220534640e -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:55 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:55 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" returned: 0 in 0.416s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-quobyte-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a" released by "delete_volume" :: held 1.006s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:55 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 Apr 24 15:35:55 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Created reservations ['140e135f-8a22-499f-9b8d-bf3a895d67a7', '5855f527-ab0a-4d01-b576-8570055e3096', '8b575272-c7bc-4c73-97fe-f20caadd58b8', '0fca8866-354c-4f6f-a9a2-df27c96cb162'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:55 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:35:55 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:56 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21" returned: 0 in 0.445s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:56 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info Apr 24 15:35:56 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:56 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.426s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:35:56 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Deleted volume successfully. Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-fc32fde8-f0a0-4c97-87ab-1d2e55b149a8 tempest-VolumesActionsTest-1706277182 None] Lock "cinder-2ac483c4-cd20-4b49-b9e9-d6c3e9b8b13a-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:35:56 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:56 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:35:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:56 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info Apr 24 15:35:56 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:57 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.info" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Creating offline snapshot 328b4ffe-9e30-4c8f-9d35-40845daea3be of volume b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7714f-fd21-419e-a0f2-41ae928b3c44]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:57 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 Apr 24 15:35:57 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:57 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:57 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be 1G Apr 24 15:35:57 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:58 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be 1G" returned: 0 in 0.607s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:58 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be Apr 24 15:35:58 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:58 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be" returned: 0 in 0.509s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:58 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:35:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:58 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be Apr 24 15:35:58 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:59 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be" returned: 0 in 0.459s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:59 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info Apr 24 15:35:59 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:35:59 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 24 15:35:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info" returned: 0 in 0.481s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:35:59 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:35:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:35:59 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info Apr 24 15:35:59 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:00 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.info" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.744s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-827860081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:35:52Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Creating volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:00 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:00 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1073741824 Apr 24 15:36:00 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e37fb042-cea0-4f97-9e4e-8fcebcd0d3bb tempest-GroupSnapshotsTest-2971181 None] group_snapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: created successfully Apr 24 15:36:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: deleting Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: deleting {{(pid=81909) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-0a786578-87b1-45d8-82f1-e95edbe17e21" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0a786578-87b1-45d8-82f1-e95edbe17e21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Deleting offline snapshot 0a786578-87b1-45d8-82f1-e95edbe17e21 of volume fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] snapshot_file for this snap is: volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aac6ff-3209-456b-ba9e-9f90f4e575e7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:00 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 Apr 24 15:36:00 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:01 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1073741824" returned: 0 in 0.852s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:01 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:01 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:01 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21" returned: 0 in 0.614s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcc1cca1-5a5a-462e-a544-2f220534640e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebb49b-74b0-47a4-a76b-4096f3d81bce]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:01 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e Apr 24 15:36:01 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:01 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 0 in 0.497s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Attempting download of 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1db52-ce6f-43d6-8de0-4c5f19abe8a0]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:01 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k Apr 24 15:36:01 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:02 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e" returned: 0 in 0.567s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:02 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 Apr 24 15:36:02 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:02 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:02 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k Apr 24 15:36:02 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:02 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21" returned: 0 in 0.757s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:02 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21 Apr 24 15:36:02 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:02 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k" returned: 1 in 0.571s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35d86ae8-c267-4804-98fd-3c88f2d8852d_lfs1gz6k' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9132758-e97e-40a5-bc93-d3ff34227537]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:02 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD Apr 24 15:36:02 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:03 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e.0a786578-87b1-45d8-82f1-e95edbe17e21" returned: 0 in 0.495s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-0a786578-87b1-45d8-82f1-e95edbe17e21" released by "_delete_snapshot" :: held 2.572s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" released by "delete_snapshot" :: held 2.598s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-328b4ffe-9e30-4c8f-9d35-40845daea3be" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-328b4ffe-9e30-4c8f-9d35-40845daea3be" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Deleting offline snapshot 328b4ffe-9e30-4c8f-9d35-40845daea3be of volume b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] snapshot_file for this snap is: volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17bc51-6e00-4910-8d2d-380f76f8886d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:03 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] 35d86ae8-c267-4804-98fd-3c88f2d8852d was qcow2, converting to raw {{(pid=81909) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 15:36:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:03 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:03 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:03 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be Apr 24 15:36:03 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:04 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be" returned: 0 in 0.596s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ba6c9-ca21-49e3-9d4d-49aa00beb1e4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:04 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 Apr 24 15:36:04 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:04 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" returned: 0 in 0.673s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:04 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be Apr 24 15:36:04 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:05 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 0 in 1.521s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35d86ae8-c267-4804-98fd-3c88f2d8852d_mj9v938zdevstack@QuobyteHD, size 112.00 MB, duration 1.52 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:36:05 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Converted 112.00 MB image at 73.55 MB/s Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:05 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1G Apr 24 15:36:05 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:05 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be" returned: 0 in 0.656s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:05 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be Apr 24 15:36:05 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:05 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e 1G" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe2845e-695c-4a2d-8b09-abd0d9cafa14]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:05 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:05 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:05 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7.328b4ffe-9e30-4c8f-9d35-40845daea3be" returned: 0 in 0.476s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-328b4ffe-9e30-4c8f-9d35-40845daea3be" released by "_delete_snapshot" :: held 2.508s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" released by "delete_snapshot" :: held 2.536s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:06 devstack cinder-volume[81909]: WARNING cinder.quota [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1998274312 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1998274312, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:06 devstack cinder-volume[81909]: WARNING cinder.quota [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1998274312 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1998274312, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['b75b9890-c560-4d60-99ab-9352c41f5f8f', '6f35f988-074a-461c-9935-128379558fec', 'ddb3bd9c-ce87-412b-8dbf-7072b216b73c', '9245c647-7e12-46a4-81fe-2285c0ecb955'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:06 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['f73295e6-b873-4bf8-9440-d6dbcb8b98d6', '198ab49d-0009-4d6e-86b5-459b29b3b990', '569cf2bd-f46b-4199-8f8c-f90b64822781', '667db641-cc9c-4a7f-8a86-71b2c9faef3d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 0 in 0.584s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4bc074f6-234d-4610-aaf1-cb7a5c995b49 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 57964328-22b4-40d3-b75e-e8c6b9b6ff94: deleted successfully Apr 24 15:36:06 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:06 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:06 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 1 in 0.642s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Downloaded image 35d86ae8-c267-4804-98fd-3c88f2d8852d ((None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}])) to volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e successfully. {{(pid=81909) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Temporary image 35d86ae8-c267-4804-98fd-3c88f2d8852d for user a24865fc6fb8498b88aa4faa232a3633 is deleted. {{(pid=81909) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.volume_utils [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Marking volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e as bootable. {{(pid=81909) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Copying metadata from image 35d86ae8-c267-4804-98fd-3c88f2d8852d to 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e. {{(pid=81909) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Creating volume glance metadata for volume 223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e backed by image 35d86ae8-c267-4804-98fd-3c88f2d8852d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81909) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a223f4-52f0-4549-b4f0-bc56651af501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e', 'volume_size': 1, 'image_id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35d86ae8-c267-4804-98fd-3c88f2d8852d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff84a5cd74a142a589c8c53bff49d1e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35d86ae8-c267-4804-98fd-3c88f2d8852d', 'created_at': datetime.datetime(2026, 4, 24, 13, 23, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 13, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35d86ae8-c267-4804-98fd-3c88f2d8852d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b4995e-bc7c-4b54-8ff3-dc418c644ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:06 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Volume volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e (223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e): created successfully Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b4995e-bc7c-4b54-8ff3-dc418c644ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (7eff931c-5996-431d-b31c-41e637559716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7eb40845-05f7-46ab-9605-f100ba6c5b11 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:36:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f02e44b-7152-43be-8d8e-548d3519dd54]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:07 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 Apr 24 15:36:07 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:08 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" returned: 0 in 0.738s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:08 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7 Apr 24 15:36:08 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (a723ba65-a531-41dc-836c-e7c150a780b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c220ecf5-c016-4c78-81d6-50a89ad7107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c220ecf5-c016-4c78-81d6-50a89ad7107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-805688479',display_name='tempest-VolumesGetTest-Volume-2121415672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af3707e-5d38-4dd5-aff2-78e9dca12137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:09Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf487fe7-cd31-4dd1-973b-5c245ede185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf487fe7-cd31-4dd1-973b-5c245ede185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b8fa56-13bb-4e46-a4ca-a0bd4a8d99d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b8fa56-13bb-4e46-a4ca-a0bd4a8d99d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af3707e-5d38-4dd5-aff2-78e9dca12137', 'volume_name': 'volume-0af3707e-5d38-4dd5-aff2-78e9dca12137', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea339d-dd42-427f-b09b-155a2967c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea339d-dd42-427f-b09b-155a2967c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8262a5-8288-420b-ace2-46c4b8d54905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Volume 0af3707e-5d38-4dd5-aff2-78e9dca12137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af3707e-5d38-4dd5-aff2-78e9dca12137', 'volume_size': 1} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-805688479',display_name='tempest-VolumesGetTest-Volume-2121415672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af3707e-5d38-4dd5-aff2-78e9dca12137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28afb1c0f8ff4d6ab3be6963c13a6dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:09Z,use_quota=True,user_id='a24865fc6fb8498b88aa4faa232a3633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Creating volume 0af3707e-5d38-4dd5-aff2-78e9dca12137 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:08 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:08 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 1073741824 Apr 24 15:36:08 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:08 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" returned: 0 in 0.578s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-b7fedc2b-ff38-471b-9ee4-1d4b96d553a7" released by "delete_volume" :: held 1.391s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" acquired by "delete_volume" :: waited 0.033s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5fa5f-bc92-4de5-947f-a90ef7de55c7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:09 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e Apr 24 15:36:09 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:09 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 1073741824" returned: 0 in 0.793s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:09 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 Apr 24 15:36:09 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:09 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e" returned: 0 in 0.704s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:09 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e Apr 24 15:36:09 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:10 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137" returned: 0 in 0.660s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8262a5-8288-420b-ace2-46c4b8d54905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af3707e-5d38-4dd5-aff2-78e9dca12137', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c4bda-0e74-4e38-9b50-a0882763eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Volume volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 (0af3707e-5d38-4dd5-aff2-78e9dca12137): created successfully Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c4bda-0e74-4e38-9b50-a0882763eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Flow 'volume_create_manager' (a723ba65-a531-41dc-836c-e7c150a780b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8527a35c-92eb-42eb-af89-c6a518e0a150 tempest-VolumesGetTest-1668668084 None] Created volume successfully. Apr 24 15:36:10 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fcc1cca1-5a5a-462e-a544-2f220534640e" returned: 0 in 0.654s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fcc1cca1-5a5a-462e-a544-2f220534640e" released by "delete_volume" :: held 1.430s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Created reservations ['9224d794-46b9-46ff-9007-e75dc8f54627'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:10 devstack cinder-volume[81909]: WARNING cinder.quota [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1998274312 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1998274312, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Created reservations ['e5a91048-2c69-4d92-b584-ed1345427ef8', '86e543d6-d7f7-4bc2-b461-f6705380e558', 'e7e30995-b106-4e66-aafc-4afac0fb2015', 'e3f51264-bda3-43a5-af54-3ab4743d03c9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Created reservations ['91a9c098-3408-4db4-8b6b-6871c24987fb', 'ad32c3ca-f62e-4f67-bc8e-f225d4b9bb37', 'bb9dc465-5611-42d1-8f1a-be94f97130df', '0d90a46c-af4f-4af3-83dc-3e3ae8011154'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (0211e905-c430-486a-ac82-a11c7809feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39871c9b-d935-4eaf-812d-11237b50d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39871c9b-d935-4eaf-812d-11237b50d578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1850478117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2302f-e591-4ff3-9120-76872b71b7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:11Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3690e0f-208b-4a3e-9a7b-2e6118ef2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3690e0f-208b-4a3e-9a7b-2e6118ef2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fb1e8f-7f31-4184-b7a9-5247250717ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fb1e8f-7f31-4184-b7a9-5247250717ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a2302f-e591-4ff3-9120-76872b71b7bd', 'volume_name': 'volume-10a2302f-e591-4ff3-9120-76872b71b7bd', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f686131-8d6c-4602-876b-3776e382f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f686131-8d6c-4602-876b-3776e382f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517f2ed2-ec7c-462f-a862-03c2eccf73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:10 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Volume 10a2302f-e591-4ff3-9120-76872b71b7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a2302f-e591-4ff3-9120-76872b71b7bd', 'volume_size': 1} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1850478117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2302f-e591-4ff3-9120-76872b71b7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:11Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Creating volume 10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:10 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:10 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd 1073741824 Apr 24 15:36:10 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-0af3707e-5d38-4dd5-aff2-78e9dca12137-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "cinder-0af3707e-5d38-4dd5-aff2-78e9dca12137-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:10 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:10 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-0af3707e-5d38-4dd5-aff2-78e9dca12137" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0af3707e-5d38-4dd5-aff2-78e9dca12137" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[187972bb-59b0-4d46-847c-ecd36e10d1a5]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:11 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 Apr 24 15:36:11 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-db67cc9f-8448-43e7-ad45-5c07369da9c0 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-1116848723: creating Apr 24 15:36:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-db67cc9f-8448-43e7-ad45-5c07369da9c0 tempest-GroupSnapshotsTest-2971181 None] Group tempest-GroupSnapshotsTest-Group-1116848723: created successfully Apr 24 15:36:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-db67cc9f-8448-43e7-ad45-5c07369da9c0 tempest-GroupSnapshotsTest-2971181 None] Create group completed successfully. Apr 24 15:36:11 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.605s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d284790b-beb3-4c4a-826f-338b4176d0ee tempest-GroupSnapshotsTest-2971181 None] Delete group completed successfully. Apr 24 15:36:11 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd 1073741824" returned: 0 in 0.707s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:11 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd Apr 24 15:36:11 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:11 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137" returned: 0 in 0.703s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:11 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137 Apr 24 15:36:11 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:12 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd" returned: 0 in 0.496s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517f2ed2-ec7c-462f-a862-03c2eccf73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a2302f-e591-4ff3-9120-76872b71b7bd', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f41fb53-eec1-4e9c-a6d4-6a724f3b9295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Volume volume-10a2302f-e591-4ff3-9120-76872b71b7bd (10a2302f-e591-4ff3-9120-76872b71b7bd): created successfully Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f41fb53-eec1-4e9c-a6d4-6a724f3b9295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (0211e905-c430-486a-ac82-a11c7809feaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:12 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ed9bd964-2eb6-41d6-9a8c-873f7de46ded tempest-VolumesSnapshotTestJSON-524729675 None] Created volume successfully. Apr 24 15:36:12 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0af3707e-5d38-4dd5-aff2-78e9dca12137" returned: 0 in 0.427s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-0af3707e-5d38-4dd5-aff2-78e9dca12137" released by "delete_volume" :: held 1.167s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Created reservations ['5104348b-5404-45d9-905d-c940f660feb7', '6ce0a8b4-965e-4f23-a872-e16625033024', '9f3fbe12-b1fe-4fee-88d4-a0c32cae7f5d', 'f22fe87f-d91c-4284-8ff9-be0634065893'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:12 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:12 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:12 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.524s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:12 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (d367603a-fe10-42a2-8805-d880d18c01bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9a5b9f-f247-4425-8869-7dadb8588964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9a5b9f-f247-4425-8869-7dadb8588964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-438114448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f784e730-f874-496a-b988-99725ca80613,host='devstack@QuobyteHD#QuobyteHD',id=1a0e586f-a88d-416c-b597-913b1ef62c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:13Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2917b35-0387-4f76-ada6-4e27c1b759bf),volume_type_id=e2917b35-0387-4f76-ada6-4e27c1b759bf)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb3f34f-a901-4458-a5fa-8fc810638b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb3f34f-a901-4458-a5fa-8fc810638b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b7f8d0-6c23-4777-89c4-fc52a0ddcd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b7f8d0-6c23-4777-89c4-fc52a0ddcd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0e586f-a88d-416c-b597-913b1ef62c75', 'volume_name': 'volume-1a0e586f-a88d-416c-b597-913b1ef62c75', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4bbb84-ed2f-4244-95db-bff49ee7bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4bbb84-ed2f-4244-95db-bff49ee7bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47802ef-1df5-4196-bb2c-2ff1d64541bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:12 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Volume 1a0e586f-a88d-416c-b597-913b1ef62c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0e586f-a88d-416c-b597-913b1ef62c75', 'volume_size': 1} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f784e730-f874-496a-b988-99725ca80613,created_at=2026-04-24T13:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-438114448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f784e730-f874-496a-b988-99725ca80613,host='devstack@QuobyteHD#QuobyteHD',id=1a0e586f-a88d-416c-b597-913b1ef62c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c1531e72c0432ab8a44cb10db5577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:13Z,use_quota=True,user_id='e90961ebcda046b0b63949f796474897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2917b35-0387-4f76-ada6-4e27c1b759bf),volume_type_id=e2917b35-0387-4f76-ada6-4e27c1b759bf)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Creating volume 1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:12 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8e384bae-2c21-467e-b02d-121673c54ad1 tempest-VolumesGetTest-1668668084 None] Lock "cinder-0af3707e-5d38-4dd5-aff2-78e9dca12137-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:12 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 1073741824 Apr 24 15:36:12 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "cinder-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Acquiring lock "cinder-quobyte-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d264a-f317-4059-bf0b-2dbd5bd52aad]: (4, 'raw') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:13 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:13 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:13 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 1073741824" returned: 0 in 0.658s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:13 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 Apr 24 15:36:13 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:13 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 0 in 0.530s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:13 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:13 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:14 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.949s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47802ef-1df5-4196-bb2c-2ff1d64541bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0e586f-a88d-416c-b597-913b1ef62c75', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526699b9-bf69-4c7b-8b05-ebe2e378c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Creating offline snapshot fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 of volume 10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:14 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Volume volume-1a0e586f-a88d-416c-b597-913b1ef62c75 (1a0e586f-a88d-416c-b597-913b1ef62c75): created successfully Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526699b9-bf69-4c7b-8b05-ebe2e378c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Flow 'volume_create_manager' (d367603a-fe10-42a2-8805-d880d18c01bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6133c0fb-90bc-4828-ada0-07e322cb07b6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:14 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c44465dc-4c33-48db-8489-a7498baf6b9e tempest-GroupSnapshotsTest-2971181 None] Created volume successfully. Apr 24 15:36:14 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd Apr 24 15:36:14 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:14 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 1 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e' failed. Not Retrying. {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:14 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e Apr 24 15:36:14 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:14 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:14 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 1G Apr 24 15:36:14 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:14 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" returned: 0 in 0.418s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "cinder-quobyte-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e" released by "delete_volume" :: held 1.509s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Created reservations ['e9a8bb9a-53da-4391-8cf6-e4eee7920e69', '841cf724-e6d8-4ec9-9b66-5d2ca4dc8316', '4d1c877d-cbff-43e3-bd44-e11cb9a2a2a6', '847ff977-f40b-4f7f-a140-932a1215f0fa'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:14 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:14 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:15 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] GroupSnapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: creating. Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Group snapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: creating. {{(pid=81909) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:15 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 1G" returned: 0 in 0.658s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a2302f-e591-4ff3-9120-76872b71b7bd -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:15 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a2302f-e591-4ff3-9120-76872b71b7bd -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 Apr 24 15:36:15 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:15 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.583s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:15 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Deleted volume successfully. Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1cb88ff0-f26d-47a5-a1c1-90d2de9997f8 tempest-VolumesGetTest-1668668084 None] Lock "cinder-223d2e86-c45d-4593-8cb8-ad8c6d8c6f4e-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:15 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a2302f-e591-4ff3-9120-76872b71b7bd -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:15 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 is being set with open permissions: ugo+rw Apr 24 15:36:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:15 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 Apr 24 15:36:15 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:16 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" returned: 0 in 0.462s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:16 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info Apr 24 15:36:16 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:16 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info" returned: 0 in 0.487s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:16 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info is being set with open permissions: ugo+rw Apr 24 15:36:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:16 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info Apr 24 15:36:16 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:17 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.info" returned: 0 in 0.463s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.229s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.074s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Creating offline snapshot fed41724-3356-4723-91a9-92465f4eef73 of volume 1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beca5ca-d62a-41e8-bc38-872058716042]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:17 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-14b6eaa6-d33c-466a-bfe2-cf1a22994ad6 tempest-VolumesSnapshotTestJSON-524729675 None] Create snapshot completed successfully Apr 24 15:36:17 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 Apr 24 15:36:17 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:17 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:17 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 1G Apr 24 15:36:17 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:17 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Flow 'volume_create_manager' (96c2df75-4e72-4003-a334-efc245a621fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d5d1a-1dfa-4a16-9a83-33fb756fd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d5d1a-1dfa-4a16-9a83-33fb756fd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2129419419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc00b97-4178-450e-917e-3e867f8ba1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e8b4918ce143de86308fe3f28b9cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:18Z,use_quota=True,user_id='c84a96c4bfc747cf926fd6dc56245d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f307d-8f3b-4bd8-ac54-82d7ca7ddf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f307d-8f3b-4bd8-ac54-82d7ca7ddf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829bb98d-d77f-45b5-b743-60487ca416cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829bb98d-d77f-45b5-b743-60487ca416cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc00b97-4178-450e-917e-3e867f8ba1ae', 'volume_name': 'volume-ebc00b97-4178-450e-917e-3e867f8ba1ae', 'volume_size': 2}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f5925-818d-40ed-80b9-6a6c4513375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f5925-818d-40ed-80b9-6a6c4513375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3710c7af-7d69-4ec0-b3db-116074fea629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:18 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Volume ebc00b97-4178-450e-917e-3e867f8ba1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc00b97-4178-450e-917e-3e867f8ba1ae', 'volume_size': 2} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:18 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 1G" returned: 0 in 0.663s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0e586f-a88d-416c-b597-913b1ef62c75 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:18 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0e586f-a88d-416c-b597-913b1ef62c75 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 Apr 24 15:36:18 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Deleting offline snapshot fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 of volume 10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] snapshot_file for this snap is: volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b71eb65-361d-4a12-ab23-711644fbc24a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:18 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 Apr 24 15:36:18 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:19 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0e586f-a88d-416c-b597-913b1ef62c75 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73" returned: 0 in 0.525s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:19 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:19 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 Apr 24 15:36:19 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:19 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" returned: 0 in 0.578s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a2302f-e591-4ff3-9120-76872b71b7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b112e4-3b24-4add-81e5-d5e2783d5056]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:19 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd Apr 24 15:36:19 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:19 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73" returned: 0 in 0.464s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:19 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info Apr 24 15:36:19 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:19 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd" returned: 0 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:19 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 Apr 24 15:36:19 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:19 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:19 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:20 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info Apr 24 15:36:20 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:20 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" returned: 0 in 0.550s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:20 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0 Apr 24 15:36:20 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:20 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.info" returned: 0 in 0.450s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.193s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2129419419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc00b97-4178-450e-917e-3e867f8ba1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e8b4918ce143de86308fe3f28b9cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:18Z,use_quota=True,user_id='c84a96c4bfc747cf926fd6dc56245d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Creating volume ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:20 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae 2147483648 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:20 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae 2147483648 Apr 24 15:36:20 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6d808cff-b941-471b-a46c-3e5b074d1efe tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: created successfully Apr 24 15:36:20 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd.fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" returned: 0 in 0.453s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0" released by "_delete_snapshot" :: held 2.181s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" released by "delete_snapshot" :: held 2.201s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['5fe88ae9-1f8c-467f-b459-6b1e84c76626', '69a25d47-bbf2-4b81-a821-19529d1ea688', 'cc834a39-86c1-4b5f-9c24-49f9ce4a0f6c', 'adba937b-cacc-4b13-94e3-469a182317ba'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Delete snapshot completed successfully. Apr 24 15:36:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a36c8b58-ed9d-448f-89e1-dec51a9cfde1 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-fd3f6db9-47fc-4f3f-ac17-67f70f2aead0-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:21 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae 2147483648" returned: 0 in 0.667s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:21 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae Apr 24 15:36:21 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: deleting Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: deleting {{(pid=81909) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-fed41724-3356-4723-91a9-92465f4eef73" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:21 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fed41724-3356-4723-91a9-92465f4eef73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Deleting offline snapshot fed41724-3356-4723-91a9-92465f4eef73 of volume 1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] snapshot_file for this snap is: volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3710c7af-7d69-4ec0-b3db-116074fea629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc00b97-4178-450e-917e-3e867f8ba1ae', 'volume_size': 2}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1c50f8-0e70-4f27-86f6-892753c3343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[624f9c15-6129-4255-903d-463ffa109664]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Volume volume-ebc00b97-4178-450e-917e-3e867f8ba1ae (ebc00b97-4178-450e-917e-3e867f8ba1ae): created successfully Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1c50f8-0e70-4f27-86f6-892753c3343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Flow 'volume_create_manager' (96c2df75-4e72-4003-a334-efc245a621fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2c4e6c91-ce43-43a7-ae4b-7809c190ca04 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Created volume successfully. Apr 24 15:36:21 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 Apr 24 15:36:21 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (97542b25-7743-4c3f-9d44-adea5d395fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8462593-4908-4140-8ee0-286cab6a3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8462593-4908-4140-8ee0-286cab6a3ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1048101147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de373909-f16a-432a-b59a-ed0a0b958924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:22Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a231a-2d1b-489c-afeb-5e430171f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a231a-2d1b-489c-afeb-5e430171f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d7d8d-42e3-49b2-b659-c97d4892f32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d7d8d-42e3-49b2-b659-c97d4892f32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de373909-f16a-432a-b59a-ed0a0b958924', 'volume_name': 'volume-de373909-f16a-432a-b59a-ed0a0b958924', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d7868c-c1d6-4a6b-985e-2d1c64a975a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d7868c-c1d6-4a6b-985e-2d1c64a975a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b80118-5c82-48f8-8b41-40b5b8918c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:22 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Volume de373909-f16a-432a-b59a-ed0a0b958924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de373909-f16a-432a-b59a-ed0a0b958924', 'volume_size': 1} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1048101147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de373909-f16a-432a-b59a-ed0a0b958924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:22Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Creating volume de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:22 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:22 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 1073741824 Apr 24 15:36:22 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:22 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73" returned: 0 in 0.631s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0e586f-a88d-416c-b597-913b1ef62c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[353de693-7416-4279-b5b8-359f6671b612]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:22 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 Apr 24 15:36:22 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:22 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 1073741824" returned: 0 in 0.629s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:22 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:22 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:23 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75" returned: 0 in 0.606s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:23 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 Apr 24 15:36:23 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:23 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.465s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.919s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b80118-5c82-48f8-8b41-40b5b8918c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de373909-f16a-432a-b59a-ed0a0b958924', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1271d514-8a10-4c1c-aad9-e128a95dbdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Creating offline snapshot dde39ca8-fe95-4441-92c2-91c7adc866b5 of volume ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Volume volume-de373909-f16a-432a-b59a-ed0a0b958924 (de373909-f16a-432a-b59a-ed0a0b958924): created successfully Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1271d514-8a10-4c1c-aad9-e128a95dbdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (97542b25-7743-4c3f-9d44-adea5d395fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b41c1ac-e6f0-4f59-b92b-183ab295fcd8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-319a840f-96e1-4a3a-b98a-d892a1dc8cf6 tempest-VolumesSnapshotTestJSON-524729675 None] Created volume successfully. Apr 24 15:36:23 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae Apr 24 15:36:23 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:23 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73" returned: 0 in 0.566s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:23 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73 Apr 24 15:36:23 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:24 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae" returned: 0 in 0.554s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 2G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:24 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 2G Apr 24 15:36:24 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:24 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75.fed41724-3356-4723-91a9-92465f4eef73" returned: 0 in 0.431s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-fed41724-3356-4723-91a9-92465f4eef73" released by "_delete_snapshot" :: held 2.386s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" released by "delete_snapshot" :: held 2.410s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:24 devstack cinder-volume[81909]: WARNING cinder.quota [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1561825707 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1561825707, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:24 devstack cinder-volume[81909]: WARNING cinder.quota [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1561825707 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1561825707, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['141b0862-a01e-47c5-b157-ced049c89e90', 'a553e041-b64e-4b66-a9b7-e171b84337ef', '579b4ae3-e221-41ec-8f59-8fb920425352', '5a2fed4f-f664-4f51-8da7-0fd7daadec3b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c4a3ec9b-3b63-46dd-9faa-02ea6d457318 tempest-GroupSnapshotsTest-2971181 None] group_snapshot 2c48617d-03f1-4d49-98be-65ca07d6b150: deleted successfully Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:24 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 2G" returned: 0 in 0.646s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc00b97-4178-450e-917e-3e867f8ba1ae -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:24 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc00b97-4178-450e-917e-3e867f8ba1ae -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 Apr 24 15:36:24 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda29ce-706e-4d20-b8f4-5a388ad16a6e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:25 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc00b97-4178-450e-917e-3e867f8ba1ae -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:25 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 is being set with open permissions: ugo+rw Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:25 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 Apr 24 15:36:25 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:25 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 Apr 24 15:36:25 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:25 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5" returned: 0 in 0.464s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:25 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info Apr 24 15:36:25 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:25 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75" returned: 0 in 0.595s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:25 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75 Apr 24 15:36:25 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:26 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:26 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info is being set with open permissions: ugo+rw Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:26 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info Apr 24 15:36:26 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:26 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1a0e586f-a88d-416c-b597-913b1ef62c75" returned: 0 in 0.438s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Lock "cinder-quobyte-1a0e586f-a88d-416c-b597-913b1ef62c75" released by "delete_volume" :: held 1.118s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['3af7b302-b984-41d0-b129-765f02200a6b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:26 devstack cinder-volume[81909]: WARNING cinder.quota [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1561825707 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1561825707, it is now deprecated. Please use the default quota class for default quota. Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Created reservations ['a3aa2f88-67ac-406e-99f1-b46d473f5fba', '294ad27b-dde6-407c-9886-9d5e1024ed2d', 'a6645211-b690-46be-89e5-309a772c209c', 'bc88fe0d-5e06-409d-a841-98c81b2d8eea'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:26 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:26 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:26 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.info" returned: 0 in 0.474s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.208s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Creating offline snapshot 9354812f-cddc-49e3-a910-a6c0b428053a of volume de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bc60bd63-62e9-4587-b098-343dfc4b9010 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Create snapshot completed successfully Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1088ac6b-97b3-40a9-8443-d4434d427e5c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:26 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:26 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:26 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.456s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:26 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-46770db0-304a-496f-9f17-f5f1662943c0 tempest-GroupSnapshotsTest-2971181 None] Delete group completed successfully. Apr 24 15:36:27 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.539s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:27 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a 1G Apr 24 15:36:27 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "cinder-dde39ca8-fe95-4441-92c2-91c7adc866b5-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-dde39ca8-fe95-4441-92c2-91c7adc866b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "cinder-quobyte-dde39ca8-fe95-4441-92c2-91c7adc866b5" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-dde39ca8-fe95-4441-92c2-91c7adc866b5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Deleting offline snapshot dde39ca8-fe95-4441-92c2-91c7adc866b5 of volume ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] snapshot_file for this snap is: volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb1bd2-f95b-4487-b73c-fbca15f2b7d0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:27 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 Apr 24 15:36:27 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:27 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a 1G" returned: 0 in 0.743s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de373909-f16a-432a-b59a-ed0a0b958924 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:28 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de373909-f16a-432a-b59a-ed0a0b958924 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:28 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:28 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5" returned: 0 in 0.578s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebc00b97-4178-450e-917e-3e867f8ba1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c94b69-c080-44db-aedd-2f2357d9850e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:28 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de373909-f16a-432a-b59a-ed0a0b958924 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.592s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:28 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a is being set with open permissions: ugo+rw Apr 24 15:36:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:28 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:28 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:28 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae Apr 24 15:36:28 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:29 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.522s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:29 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae" returned: 0 in 0.617s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:29 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info Apr 24 15:36:29 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:29 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 Apr 24 15:36:29 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:29 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info" returned: 0 in 0.476s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:29 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info is being set with open permissions: ugo+rw Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:29 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info Apr 24 15:36:29 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:29 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5" returned: 0 in 0.626s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:29 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5 Apr 24 15:36:29 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:30 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.info" returned: 0 in 0.524s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.513s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-15b92053-c47d-4f51-9c96-c1e2c813b835 tempest-VolumesSnapshotTestJSON-524729675 None] Create snapshot completed successfully Apr 24 15:36:30 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae.dde39ca8-fe95-4441-92c2-91c7adc866b5" returned: 0 in 0.553s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-dde39ca8-fe95-4441-92c2-91c7adc866b5" released by "_delete_snapshot" :: held 2.511s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" released by "delete_snapshot" :: held 2.542s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Created reservations ['d4ad0c32-401f-4329-8743-67ebf3bed115', 'f6ef1078-e978-4214-9d56-9274473a484d', 'fdd42ed3-e1de-4336-92ba-b85e70dac95a', 'c59b165b-aa82-4f4f-bccf-0637e9bdc4d8'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:30 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Delete snapshot completed successfully. Apr 24 15:36:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6383ebb2-3b5d-49c9-ae68-94ddc119e3e6 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-dde39ca8-fe95-4441-92c2-91c7adc866b5-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "cinder-ebc00b97-4178-450e-917e-3e867f8ba1ae-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3ff0ee11-ac03-4aaa-84a4-f630f5532f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b11a7b-085c-4f8e-99b7-f074ab2df2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-ebc00b97-4178-450e-917e-3e867f8ba1ae-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b11a7b-085c-4f8e-99b7-f074ab2df2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-566057501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1106515f-f9b1-48c7-8c1b-00134e5f0c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9354812f-cddc-49e3-a910-a6c0b428053a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:31Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c777cb57-b3e1-4c79-b927-87186d80c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c777cb57-b3e1-4c79-b927-87186d80c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8bcdd2-7a31-4dca-8533-5b78612f5268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8bcdd2-7a31-4dca-8533-5b78612f5268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1106515f-f9b1-48c7-8c1b-00134e5f0c24', 'volume_name': 'volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24', 'volume_size': 2, 'snapshot_id': '9354812f-cddc-49e3-a910-a6c0b428053a'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b1895-e5d0-4e42-b3c8-2a44a15a6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b1895-e5d0-4e42-b3c8-2a44a15a6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71faad8d-cd1f-450d-91fe-30bf5f758981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Volume 1106515f-f9b1-48c7-8c1b-00134e5f0c24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24', 'volume_size': 2, 'snapshot_id': '9354812f-cddc-49e3-a910-a6c0b428053a'} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a-1106515f-f9b1-48c7-8c1b-00134e5f0c24" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a-1106515f-f9b1-48c7-8c1b-00134e5f0c24" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Creating volume 1106515f-f9b1-48c7-8c1b-00134e5f0c24 from snapshot 9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" acquired by "delete_volume" :: waited 0.029s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] snapshot: 9354812f-cddc-49e3-a910-a6c0b428053a, volume: 1106515f-f9b1-48c7-8c1b-00134e5f0c24, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb533f95-4901-4e77-abc8-9dd68f0a3bd3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca155d3-2b3d-4cf7-9b45-b5aa5dbc1ec3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:31 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae Apr 24 15:36:31 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:31 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:31 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:31 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae" returned: 0 in 0.590s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:31 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae Apr 24 15:36:31 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:31 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.595s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de373909-f16a-432a-b59a-ed0a0b958924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f3c58-89af-4c5b-997c-050307cf63c0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:32 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:32 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Flow 'volume_create_manager' (00cd1b3d-6bc8-4ce1-a3e6-0f6e44458b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fd3d8-989d-41b1-b563-c5096a8b19a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fd3d8-989d-41b1-b563-c5096a8b19a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-91943237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4cef29-fd82-4728-a5a6-e860d2c4193d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b464b0c936ae4f6abbffa7ee89bb72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:32Z,use_quota=True,user_id='28f0f99d90274e509184a5940883afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42150915-67b0-4156-8245-d1e76ea97423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42150915-67b0-4156-8245-d1e76ea97423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc6b41b-dcac-402f-8925-556909ad16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc6b41b-dcac-402f-8925-556909ad16f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4cef29-fd82-4728-a5a6-e860d2c4193d', 'volume_name': 'volume-be4cef29-fd82-4728-a5a6-e860d2c4193d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a177b853-a596-452e-8405-d41afd9908b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a177b853-a596-452e-8405-d41afd9908b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942a0322-a2cf-407b-b7b9-319746cd3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Volume be4cef29-fd82-4728-a5a6-e860d2c4193d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4cef29-fd82-4728-a5a6-e860d2c4193d', 'volume_size': 1} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:32 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ebc00b97-4178-450e-917e-3e867f8ba1ae" returned: 0 in 0.464s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-quobyte-ebc00b97-4178-450e-917e-3e867f8ba1ae" released by "delete_volume" :: held 1.127s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Created reservations ['d4efea3e-c4b2-4c64-9982-3c170b8b3e95', '5d126c4d-4f0a-4904-af4f-e7a30317dc08', '5a83313a-72f7-46b9-a48d-19d385bed143', 'a280a5ac-1a9a-4019-8fff-288004b45556'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:32 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:32 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:32 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.608s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:32 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 Apr 24 15:36:32 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:32 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.428s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Deleted volume successfully. Apr 24 15:36:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8c2680d-3317-4be3-8123-f2553cdc3302 tempest-VolumesSnapshotNegativeTestJSON-957791093 None] Lock "cinder-ebc00b97-4178-450e-917e-3e867f8ba1ae-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:37 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24" returned: 0 in 4.890s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:37 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a2f2b2-55c8-4d36-99c0-65f1774136dd]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:37 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:37 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:38 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.593s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:36:38 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Converted 1024.00 MB image at 209.39 MB/s Apr 24 15:36:38 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 is being set with open permissions: ugo+rw Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:38 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 Apr 24 15:36:38 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:38 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24" returned: 0 in 0.411s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" released by "_copy_volume_from_snapshot" :: held 7.213s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a-1106515f-f9b1-48c7-8c1b-00134e5f0c24" released by "_create_volume_from_snapshot" :: held 7.278s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.296s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.195s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-91943237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4cef29-fd82-4728-a5a6-e860d2c4193d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b464b0c936ae4f6abbffa7ee89bb72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:32Z,use_quota=True,user_id='28f0f99d90274e509184a5940883afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Creating volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:38 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:INSERT=49,cinder:UPDATE=168,cinder:DELETE=7,cinder:SELECT=150 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:36:38 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d 1073741824 Apr 24 15:36:38 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=161,cinder:UPDATE=147,cinder:DELETE=11,cinder:INSERT=40 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71faad8d-cd1f-450d-91fe-30bf5f758981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24', 'volume_size': 2, 'snapshot_id': '9354812f-cddc-49e3-a910-a6c0b428053a'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d9db49-e1fe-4840-b2a1-9c939124f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Volume volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 (1106515f-f9b1-48c7-8c1b-00134e5f0c24): created successfully Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d9db49-e1fe-4840-b2a1-9c939124f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3ff0ee11-ac03-4aaa-84a4-f630f5532f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f0b912de-73ef-4c7f-b087-6295fa339771 tempest-VolumesSnapshotTestJSON-524729675 None] Created volume successfully. Apr 24 15:36:39 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d 1073741824" returned: 0 in 0.609s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:39 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d Apr 24 15:36:39 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:39 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d" returned: 0 in 0.425s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942a0322-a2cf-407b-b7b9-319746cd3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4cef29-fd82-4728-a5a6-e860d2c4193d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a5306-003a-4d02-9eb8-1942513afdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:39 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Volume volume-be4cef29-fd82-4728-a5a6-e860d2c4193d (be4cef29-fd82-4728-a5a6-e860d2c4193d): created successfully Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a5306-003a-4d02-9eb8-1942513afdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Flow 'volume_create_manager' (00cd1b3d-6bc8-4ce1-a3e6-0f6e44458b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2f455c84-72ec-4eb5-bee9-e762db0c6b6a tempest-SnapshotsActionsTest-269800342 None] Created volume successfully. Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-1106515f-f9b1-48c7-8c1b-00134e5f0c24-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-1106515f-f9b1-48c7-8c1b-00134e5f0c24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b1795-0771-4e66-814a-57ce664309ee]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:39 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 Apr 24 15:36:39 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Creating offline snapshot 222e12c8-5d19-4700-8359-afeb41be054f of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cea3365-8e91-450b-9f65-30423323831e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:40 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d Apr 24 15:36:40 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:40 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24" returned: 0 in 0.548s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:40 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24 Apr 24 15:36:40 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:40 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:40 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f 1G Apr 24 15:36:40 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:40 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-1106515f-f9b1-48c7-8c1b-00134e5f0c24" returned: 0 in 0.467s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-1106515f-f9b1-48c7-8c1b-00134e5f0c24" released by "delete_volume" :: held 1.056s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:40 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['6830100c-13e6-4572-8986-b0258500a13d', 'f56d0758-73e6-4821-adf6-3479f82a5449', '4a58652d-142b-4804-a96e-bf04d5251db5', 'ca7ee8b5-98b0-4d2b-9868-2cf9775cafe9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:41 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:41 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:41 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f 1G" returned: 0 in 0.632s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:41 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:41 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:41 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.471s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:41 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Deleted volume successfully. Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-14573f73-2a9c-42d1-8d4d-1df91058373e tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-1106515f-f9b1-48c7-8c1b-00134e5f0c24-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:41 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.476s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:41 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f is being set with open permissions: ugo+rw Apr 24 15:36:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:41 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:41 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-9354812f-cddc-49e3-a910-a6c0b428053a-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-9354812f-cddc-49e3-a910-a6c0b428053a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Deleting offline snapshot 9354812f-cddc-49e3-a910-a6c0b428053a of volume de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] snapshot_file for this snap is: volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9b8f1-39dd-432e-a57f-3f5a88d47b45]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:42 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.453s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:42 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:42 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:42 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info Apr 24 15:36:42 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:42 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.500s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de373909-f16a-432a-b59a-ed0a0b958924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:42 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info" returned: 0 in 0.428s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:42 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info is being set with open permissions: ugo+rw Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b0363-10ef-4707-b054-f8b3279e4315]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:42 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info Apr 24 15:36:42 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:42 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:42 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:43 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.info" returned: 0 in 0.403s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:43 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c9139d78-49c3-42b5-bf08-be61dd23e925 tempest-SnapshotsActionsTest-269800342 None] Create snapshot completed successfully Apr 24 15:36:43 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.553s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:43 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:43 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:43 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.568s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:43 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a Apr 24 15:36:43 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Creating offline snapshot 61285b45-1f7a-458b-a73c-117ec13ce109 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[48417302-cd86-4115-b611-3302b8414d80]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:43 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:43 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:44 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924.9354812f-cddc-49e3-a910-a6c0b428053a" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-9354812f-cddc-49e3-a910-a6c0b428053a" released by "_delete_snapshot" :: held 2.180s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" released by "delete_snapshot" :: held 2.201s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['34d5268f-5aac-42ab-8b3d-985f02f084af', '387bf24c-40be-4a38-a52d-cf46c2f6e8f4', 'cbdc0c2c-50b9-4635-a0f3-822f0090c2ff', 'd04a255f-e59e-4333-9897-d315ed6ed01d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Delete snapshot completed successfully. Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-83054f1c-3b2c-4144-a1e3-e3559409e321 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-9354812f-cddc-49e3-a910-a6c0b428053a-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:44 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.539s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:44 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 1G Apr 24 15:36:44 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:45 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 1G" returned: 0 in 0.590s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:45 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 Apr 24 15:36:45 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-de373909-f16a-432a-b59a-ed0a0b958924-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-de373909-f16a-432a-b59a-ed0a0b958924-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4536bb-d66f-4723-bf9e-428c266ff33f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:45 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:45 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:45 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109" returned: 0 in 0.479s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:45 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 is being set with open permissions: ugo+rw Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:45 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 Apr 24 15:36:45 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:45 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.514s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:45 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924 Apr 24 15:36:45 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:45 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109" returned: 0 in 0.445s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-525e42de-a2a3-4d1b-955d-3f051e47a592 tempest-SnapshotsActionsTest-269800342 None] Create snapshot completed successfully Apr 24 15:36:46 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-de373909-f16a-432a-b59a-ed0a0b958924" returned: 0 in 0.422s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-de373909-f16a-432a-b59a-ed0a0b958924" released by "delete_volume" :: held 0.990s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['c5854f34-b9d0-4971-89b4-3a8c22f71460', '927366ce-fe9d-4385-b2d8-136d6cf932b0', '8ced5dbc-eb37-4dab-a27d-541745dd7e0d', 'de6b18dc-ef89-4b7d-b770-417362db4a78'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:46 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:46 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:46 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.407s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Deleted volume successfully. Apr 24 15:36:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d3687c1c-b042-4488-953e-1b0973665636 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-de373909-f16a-432a-b59a-ed0a0b958924-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-61285b45-1f7a-458b-a73c-117ec13ce109-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-61285b45-1f7a-458b-a73c-117ec13ce109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-61285b45-1f7a-458b-a73c-117ec13ce109" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-61285b45-1f7a-458b-a73c-117ec13ce109" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Deleting offline snapshot 61285b45-1f7a-458b-a73c-117ec13ce109 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] snapshot_file for this snap is: volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf57192-14bf-4a03-8e8d-92b6281c0c81]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:47 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 Apr 24 15:36:47 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:47 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109" returned: 0 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251cf30-06e4-460e-95a1-29fbf824376a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:47 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:47 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3290b527-140d-4cc0-861a-d320eede71e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6d7d26-c1e2-43e1-bf42-f237555799af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6d7d26-c1e2-43e1-bf42-f237555799af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-140324432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e1d2a-1be7-45c5-b7ff-e39743976730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:48Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bd555c-bebd-44d4-a539-d1ba9c35ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bd555c-bebd-44d4-a539-d1ba9c35ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e2c81a-3c24-4594-a7a8-d92eb7dd9fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e2c81a-3c24-4594-a7a8-d92eb7dd9fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37e1d2a-1be7-45c5-b7ff-e39743976730', 'volume_name': 'volume-e37e1d2a-1be7-45c5-b7ff-e39743976730', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2acae06-e969-4669-a285-d9dbd10d03da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2acae06-e969-4669-a285-d9dbd10d03da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba888b-b259-489c-ba97-75775b3e7e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:47 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Volume e37e1d2a-1be7-45c5-b7ff-e39743976730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37e1d2a-1be7-45c5-b7ff-e39743976730', 'volume_size': 1} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-140324432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e1d2a-1be7-45c5-b7ff-e39743976730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:48Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Creating volume e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:47 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:36:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:47 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 1073741824 Apr 24 15:36:47 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:48 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:48 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 Apr 24 15:36:48 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:48 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 1073741824" returned: 0 in 0.591s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:48 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:36:48 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:48 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109" returned: 0 in 0.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:48 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109 Apr 24 15:36:48 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:49 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.436s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba888b-b259-489c-ba97-75775b3e7e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e1d2a-1be7-45c5-b7ff-e39743976730', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e593fe8-da22-4210-8dac-235fb21eb5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:49 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Volume volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 (e37e1d2a-1be7-45c5-b7ff-e39743976730): created successfully Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e593fe8-da22-4210-8dac-235fb21eb5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3290b527-140d-4cc0-861a-d320eede71e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-43a8c63c-57a1-4af4-85d9-d1a88656c544 tempest-VolumesSnapshotTestJSON-524729675 None] Created volume successfully. Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:49 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:36:49 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:49 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.61285b45-1f7a-458b-a73c-117ec13ce109" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-61285b45-1f7a-458b-a73c-117ec13ce109" released by "_delete_snapshot" :: held 2.157s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_snapshot" :: held 2.180s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Created reservations ['502cb7a0-ddf2-47ed-b310-c39b98b3a9c7', '64ceb9ae-3175-451b-a178-03bf6a1ef712', '59906101-34e3-47a2-8e4b-ef08c4c120bb', '2f2db236-b233-46aa-b10c-bf860cdc9ca9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Delete snapshot completed successfully. Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b11cd0b3-11c4-4ac5-9a23-6f54efb6228f tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-61285b45-1f7a-458b-a73c-117ec13ce109-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:49 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.456s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Creating offline snapshot 2c64fae2-d35a-4fd4-b6b6-9d82d007718a of volume e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c62baf-2860-457a-a5ba-cb67d71781a7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:50 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:36:50 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:50 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:50 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a 1G Apr 24 15:36:50 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:51 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a 1G" returned: 0 in 0.554s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:51 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:36:51 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:51 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.438s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:51 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a is being set with open permissions: ugo+rw Apr 24 15:36:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:51 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:36:51 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:52 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.416s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:52 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info Apr 24 15:36:52 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:52 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info" returned: 0 in 0.425s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:52 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info is being set with open permissions: ugo+rw Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:52 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info Apr 24 15:36:52 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:52 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.info" returned: 0 in 0.406s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.458s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Creating offline snapshot 648dabf5-4bb2-4318-8ee0-4c26db03b76a of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:36:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-31b8b994-d77d-43c4-bcda-22d313c7d3a8 tempest-VolumesSnapshotTestJSON-524729675 None] Create snapshot completed successfully Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a12b78-3e00-4c3e-96e8-6cc584ec06b9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:53 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:53 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:53 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.575s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:36:53 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a 1G Apr 24 15:36:53 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3e38bd25-a55e-46d4-9c34-9f7e542e2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa500c4-ff1f-4a78-879d-99a4d9704120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa500c4-ff1f-4a78-879d-99a4d9704120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083959340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd3e721-6381-4c3b-bd2a-93248f79b9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c4e800679449ca6ab90295f0f4171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c64fae2-d35a-4fd4-b6b6-9d82d007718a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:36:54Z,use_quota=True,user_id='fc65d464bd4a4be096eae61578f0dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a143c20-5036-40a6-9e7c-3afd0a1e1d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a143c20-5036-40a6-9e7c-3afd0a1e1d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc29669d-52e7-4e7e-9c13-4a541f6e9f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc29669d-52e7-4e7e-9c13-4a541f6e9f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efd3e721-6381-4c3b-bd2a-93248f79b9e0', 'volume_name': 'volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0', 'volume_size': 1, 'snapshot_id': '2c64fae2-d35a-4fd4-b6b6-9d82d007718a'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c5c786-2357-423f-a4de-26927c4ec29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c5c786-2357-423f-a4de-26927c4ec29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f725c6b-ae28-407f-a90d-3c921355bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:36:53 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Volume efd3e721-6381-4c3b-bd2a-93248f79b9e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0', 'volume_size': 1, 'snapshot_id': '2c64fae2-d35a-4fd4-b6b6-9d82d007718a'} Apr 24 15:36:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:54 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a 1G" returned: 0 in 0.599s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:54 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a Apr 24 15:36:54 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:54 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a" returned: 0 in 0.494s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:54 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a is being set with open permissions: ugo+rw Apr 24 15:36:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:54 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a Apr 24 15:36:54 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:55 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a" returned: 0 in 0.395s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.415s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-efd3e721-6381-4c3b-bd2a-93248f79b9e0" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-efd3e721-6381-4c3b-bd2a-93248f79b9e0" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Creating volume efd3e721-6381-4c3b-bd2a-93248f79b9e0 from snapshot 2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:55 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3904ef06-2624-411a-a467-186b7b04e7fe tempest-SnapshotsActionsTest-269800342 None] Create snapshot completed successfully Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] snapshot: 2c64fae2-d35a-4fd4-b6b6-9d82d007718a, volume: efd3e721-6381-4c3b-bd2a-93248f79b9e0, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac829e-1959-4096-ba06-6de153174279]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:55 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:36:55 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:55 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.503s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e37e1d2a-1be7-45c5-b7ff-e39743976730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09d0777-d136-47e5-8d16-e706dea12ce7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-648dabf5-4bb2-4318-8ee0-4c26db03b76a-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-648dabf5-4bb2-4318-8ee0-4c26db03b76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:55 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:36:55 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-648dabf5-4bb2-4318-8ee0-4c26db03b76a" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-648dabf5-4bb2-4318-8ee0-4c26db03b76a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Deleting offline snapshot 648dabf5-4bb2-4318-8ee0-4c26db03b76a of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] snapshot_file for this snap is: volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf936ea-d49c-4bc4-b319-bc42c8027c06]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:56 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a Apr 24 15:36:56 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:56 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.526s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:56 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 Apr 24 15:36:56 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:56 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a" returned: 0 in 0.506s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f643e1-e0d4-4756-a8d7-8dbb0f56fb82]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:36:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:56 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:36:56 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:57 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.729s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:36:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:57 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a Apr 24 15:36:57 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:58 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a" returned: 0 in 1.312s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:36:58 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a Apr 24 15:36:58 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:36:59 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 24 15:36:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.648dabf5-4bb2-4318-8ee0-4c26db03b76a" returned: 0 in 1.138s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:36:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-648dabf5-4bb2-4318-8ee0-4c26db03b76a" released by "_delete_snapshot" :: held 3.808s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_snapshot" :: held 3.837s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:36:59 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Created reservations ['ce6e85d9-439e-4388-80ff-80975c2f4ca3', '415d9fbd-92d8-49b0-81f6-5a6e90e06e8b', '18d42eae-a0a8-4843-926f-b33f534aa3e8', '1a8e66da-638d-44be-9bfe-ef081d0d331f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:36:59 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Delete snapshot completed successfully. Apr 24 15:36:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-335eae24-8ce9-4b98-88db-80d5734b493a tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-648dabf5-4bb2-4318-8ee0-4c26db03b76a-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:00 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0" returned: 0 in 4.652s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b67e42-5a3a-4f2b-b060-ef2cbbed177b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:01 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:37:01 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:01 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.599s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:01 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:37:01 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Converted 1024.00 MB image at 220.06 MB/s Apr 24 15:37:01 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 is being set with open permissions: ugo+rw Apr 24 15:37:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:01 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 Apr 24 15:37:01 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:02 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0" returned: 0 in 0.417s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" released by "_copy_volume_from_snapshot" :: held 6.798s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-efd3e721-6381-4c3b-bd2a-93248f79b9e0" released by "_create_volume_from_snapshot" :: held 6.835s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.863s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.378s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Creating offline snapshot 80728652-a093-4268-9cff-2b15c498d620 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae6632-a2d3-4a81-ab0c-8bde928102e0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f725c6b-ae28-407f-a90d-3c921355bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0', 'volume_size': 1, 'snapshot_id': '2c64fae2-d35a-4fd4-b6b6-9d82d007718a'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4b6da-98ec-4a27-a57a-771322250747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:02 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Volume volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 (efd3e721-6381-4c3b-bd2a-93248f79b9e0): created successfully Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4b6da-98ec-4a27-a57a-771322250747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Flow 'volume_create_manager' (3e38bd25-a55e-46d4-9c34-9f7e542e2071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bcc50c46-1383-4c19-9f98-45d1cce4fc01 tempest-VolumesSnapshotTestJSON-524729675 None] Created volume successfully. Apr 24 15:37:02 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:02 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-efd3e721-6381-4c3b-bd2a-93248f79b9e0-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-efd3e721-6381-4c3b-bd2a-93248f79b9e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[864ad2f6-9a51-40bd-95be-573e571a928d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:02 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 Apr 24 15:37:02 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:02 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:02 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 1G Apr 24 15:37:02 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:03 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0" returned: 0 in 0.548s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:03 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0 Apr 24 15:37:03 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:03 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 1G" returned: 0 in 0.613s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:03 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 Apr 24 15:37:03 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:03 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-efd3e721-6381-4c3b-bd2a-93248f79b9e0" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-efd3e721-6381-4c3b-bd2a-93248f79b9e0" released by "delete_volume" :: held 1.056s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['845e5a81-0d3b-4a75-b57c-991695d0e5f2', 'bc111876-f55f-40d2-bc52-6a3fbb1c1bce', '8a3a5378-690b-4b86-930a-2d82fd3bca5c', 'da5c6f69-4117-41bc-84b3-bf5524f87cc8'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:03 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:03 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:03 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620" returned: 0 in 0.497s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:03 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 is being set with open permissions: ugo+rw Apr 24 15:37:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:03 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 Apr 24 15:37:03 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:04 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.419s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Deleted volume successfully. Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8d0bdf8a-0043-447c-b3f4-77391813c882 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-efd3e721-6381-4c3b-bd2a-93248f79b9e0-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:04 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620" returned: 0 in 0.410s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d5ccaeb5-e24e-4c04-b37e-638ae2042ee7 tempest-SnapshotsActionsTest-269800342 None] Create snapshot completed successfully Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Deleting offline snapshot 2c64fae2-d35a-4fd4-b6b6-9d82d007718a of volume e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] snapshot_file for this snap is: volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fceb19-fae9-436e-8254-54b9a6f8a29b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:04 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:37:04 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-80728652-a093-4268-9cff-2b15c498d620-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-80728652-a093-4268-9cff-2b15c498d620-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-80728652-a093-4268-9cff-2b15c498d620" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-80728652-a093-4268-9cff-2b15c498d620" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Deleting offline snapshot 80728652-a093-4268-9cff-2b15c498d620 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] snapshot_file for this snap is: volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:37:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5f3fa-1298-4e60-80c6-fcf649caccf2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:05 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 Apr 24 15:37:05 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:05 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e37e1d2a-1be7-45c5-b7ff-e39743976730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304c4cf-9cae-4b2d-a175-2f9ec9e3d940]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:05 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:37:05 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:05 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45966e0-8422-44be-8314-bcf7b575827c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:05 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:05 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:05 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.516s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:05 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:37:05 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:06 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:06 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 Apr 24 15:37:06 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:06 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.523s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:06 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a Apr 24 15:37:06 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:06 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620" returned: 0 in 0.569s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:06 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620 Apr 24 15:37:06 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:06 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730.2c64fae2-d35a-4fd4-b6b6-9d82d007718a" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-2c64fae2-d35a-4fd4-b6b6-9d82d007718a" released by "_delete_snapshot" :: held 2.110s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" released by "delete_snapshot" :: held 2.134s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['40100468-b0a7-494d-9d51-af14a8abc6b1', 'a113236b-db04-4b4e-a80e-2120f2976531', '88cc95ac-7a01-4619-93af-53b34404915f', 'bd53ab67-690d-4f2d-a623-e78e645c8120'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Delete snapshot completed successfully. Apr 24 15:37:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6c94c42a-4c62-4420-b87d-597f2050fdda tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-2c64fae2-d35a-4fd4-b6b6-9d82d007718a-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:07 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.80728652-a093-4268-9cff-2b15c498d620" returned: 0 in 0.470s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-80728652-a093-4268-9cff-2b15c498d620" released by "_delete_snapshot" :: held 2.157s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_snapshot" :: held 2.176s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Created reservations ['9106d3b5-2f94-459b-81a5-6f6310506c00', '52f21e73-e676-4f0b-8a3c-0b16174e7f52', '9d934b30-b674-4343-99b9-dadbeb84fbc3', 'b593cd09-3171-4a6e-b098-be7f0e17f3f9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Delete snapshot completed successfully. Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e156d403-2222-4a13-9561-156b870b0049 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-80728652-a093-4268-9cff-2b15c498d620-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-e37e1d2a-1be7-45c5-b7ff-e39743976730-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-e37e1d2a-1be7-45c5-b7ff-e39743976730-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49cb73e-bbc0-4f4f-80f7-e3c8c26aa3a2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:08 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:37:08 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Creating offline snapshot 15ccd070-a35c-436c-80b7-0b87f5ad6995 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f6f1c-3616-4a07-ad96-b94fff2def6e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:08 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:08 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:08 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:08 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730 Apr 24 15:37:08 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:08 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-e37e1d2a-1be7-45c5-b7ff-e39743976730" returned: 0 in 0.431s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:08 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-e37e1d2a-1be7-45c5-b7ff-e39743976730" released by "delete_volume" :: held 1.022s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.509s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:08 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 1G Apr 24 15:37:08 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['a369f0c2-de67-41ce-a77d-88716d95e4dc', '701ee88d-374b-4186-800c-4c1743c3bf84', 'b56ae303-5545-4116-90cd-ff4e83c7e66c', 'bf165b77-246c-4512-895c-fa82544aa7a4'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:09 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:09 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:09 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.474s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Deleted volume successfully. Apr 24 15:37:09 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-006a2d36-342b-456f-ad32-00895332d80a tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-e37e1d2a-1be7-45c5-b7ff-e39743976730-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 1G" returned: 0 in 0.616s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:09 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 Apr 24 15:37:09 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:10 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:10 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 is being set with open permissions: ugo+rw Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:10 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 Apr 24 15:37:10 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-10a2302f-e591-4ff3-9120-76872b71b7bd-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-10a2302f-e591-4ff3-9120-76872b71b7bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4314df2c-fed8-419a-8c50-20a4d7d9e834]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:10 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd Apr 24 15:37:10 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:10 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-051433d9-e050-4260-8ca2-6e4edafb5ef3 tempest-SnapshotsActionsTest-269800342 None] Create snapshot completed successfully Apr 24 15:37:10 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd" returned: 0 in 0.499s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:10 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd Apr 24 15:37:10 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:11 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-10a2302f-e591-4ff3-9120-76872b71b7bd" returned: 0 in 0.410s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-quobyte-10a2302f-e591-4ff3-9120-76872b71b7bd" released by "delete_volume" :: held 0.990s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Created reservations ['70ce3561-a976-4415-a53c-beebce7a5c29', '02fee7dd-8517-4c33-badb-82ca3a553801', 'd9a0e572-2902-4f7a-97a9-3b62ad7c04d4', '32c87f5a-5808-4f1b-89bc-d9b95340030b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:11 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:11 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-15ccd070-a35c-436c-80b7-0b87f5ad6995-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-15ccd070-a35c-436c-80b7-0b87f5ad6995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Acquiring lock "cinder-quobyte-15ccd070-a35c-436c-80b7-0b87f5ad6995" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-15ccd070-a35c-436c-80b7-0b87f5ad6995" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Deleting offline snapshot 15ccd070-a35c-436c-80b7-0b87f5ad6995 of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] snapshot_file for this snap is: volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba93923-fd1f-4f66-8a91-1a4d458bbea8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:11 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.443s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Deleted volume successfully. Apr 24 15:37:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e9020111-e4de-4813-be29-093a758f70b9 tempest-VolumesSnapshotTestJSON-524729675 None] Lock "cinder-10a2302f-e591-4ff3-9120-76872b71b7bd-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:11 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 Apr 24 15:37:11 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:12 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0de5db-e1e6-4e07-9a49-dd88e5e87a02]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:12 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:12 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:12 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.568s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:12 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 Apr 24 15:37:12 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:13 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995" returned: 0 in 0.664s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:13 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995 Apr 24 15:37:13 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:13 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.15ccd070-a35c-436c-80b7-0b87f5ad6995" returned: 0 in 0.446s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-15ccd070-a35c-436c-80b7-0b87f5ad6995" released by "_delete_snapshot" :: held 2.307s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_snapshot" :: held 2.336s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:14 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Created reservations ['61f53edf-74eb-4a26-8574-4be469dd78e2', 'f13c43be-8a1a-4f2f-b1c3-446e677c738e', 'f972d201-891b-4b48-845d-6325037551e2', '12cf8e6e-c03a-40f9-a5cf-4ce4cabcc8de'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:14 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Delete snapshot completed successfully. Apr 24 15:37:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec215585-dfe0-4688-b6f9-c4c84cf58687 tempest-SnapshotsActionsTest-710648532 None] Lock "cinder-15ccd070-a35c-436c-80b7-0b87f5ad6995-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "cinder-222e12c8-5d19-4700-8359-afeb41be054f-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-222e12c8-5d19-4700-8359-afeb41be054f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "cinder-quobyte-222e12c8-5d19-4700-8359-afeb41be054f" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-222e12c8-5d19-4700-8359-afeb41be054f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Deleting offline snapshot 222e12c8-5d19-4700-8359-afeb41be054f of volume be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] snapshot_file for this snap is: volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0eda3a-3e46-437b-b6ab-e2057b463396]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:15 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:15 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:15 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.586s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4cef29-fd82-4728-a5a6-e860d2c4193d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae630e32-ccdd-4fb9-b64c-69fc322cc584]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:16 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d Apr 24 15:37:16 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:16 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d" returned: 0 in 0.559s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:16 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:16 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:17 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:17 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f Apr 24 15:37:17 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:17 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d.222e12c8-5d19-4700-8359-afeb41be054f" returned: 0 in 0.440s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-222e12c8-5d19-4700-8359-afeb41be054f" released by "_delete_snapshot" :: held 2.331s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_snapshot" :: held 2.354s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (15c7a811-e3da-49fc-b880-bf185b35a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f128bdc7-8227-436d-a4bc-137721e42407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f128bdc7-8227-436d-a4bc-137721e42407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793627780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a49f87-820c-4195-833e-2994e4cdf476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:18Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30955b92-ae50-405a-afa1-c281ac62e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30955b92-ae50-405a-afa1-c281ac62e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca584a88-b036-4cb2-806d-8992c5ea535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca584a88-b036-4cb2-806d-8992c5ea535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a49f87-820c-4195-833e-2994e4cdf476', 'volume_name': 'volume-32a49f87-820c-4195-833e-2994e4cdf476', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd2c224-69bb-4cbb-974f-a04acfee563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd2c224-69bb-4cbb-974f-a04acfee563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f01ce-1c39-43ed-8c7f-99033fe3ac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:17 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume 32a49f87-820c-4195-833e-2994e4cdf476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a49f87-820c-4195-833e-2994e4cdf476', 'volume_size': 1} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793627780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a49f87-820c-4195-833e-2994e4cdf476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:18Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume 32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:17 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:17 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 1073741824 Apr 24 15:37:17 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Created reservations ['47a8435d-80ab-4410-aa76-a64d6298002a', '6f9292d4-88e5-4d82-925b-1fc68123083d', 'e6ae9a46-7578-48f3-9233-90b1fe1d339c', '30456ae9-a324-4a31-90f3-05730d080bd1'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:17 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Delete snapshot completed successfully. Apr 24 15:37:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-2298e613-8357-4789-90c1-fab84c859cb3 tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-222e12c8-5d19-4700-8359-afeb41be054f-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:18 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 1073741824" returned: 0 in 0.597s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:18 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 Apr 24 15:37:18 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "cinder-be4cef29-fd82-4728-a5a6-e860d2c4193d-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-be4cef29-fd82-4728-a5a6-e860d2c4193d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[617547c6-32d0-46cf-9822-0b3ebf936695]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:18 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d Apr 24 15:37:18 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:18 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476" returned: 0 in 0.452s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f01ce-1c39-43ed-8c7f-99033fe3ac9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a49f87-820c-4195-833e-2994e4cdf476', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63014f80-b540-4e4e-9b5e-ef27fb85c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:18 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-32a49f87-820c-4195-833e-2994e4cdf476 (32a49f87-820c-4195-833e-2994e4cdf476): created successfully Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63014f80-b540-4e4e-9b5e-ef27fb85c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:18 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (15c7a811-e3da-49fc-b880-bf185b35a60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7ab8c261-e0af-4cb1-8beb-52f2998df2a2 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:19 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:19 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d Apr 24 15:37:19 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:19 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-be4cef29-fd82-4728-a5a6-e860d2c4193d" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-quobyte-be4cef29-fd82-4728-a5a6-e860d2c4193d" released by "delete_volume" :: held 1.018s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Created reservations ['a6389958-8cc6-411f-b6ac-125d343aed42', '7f539b25-79a2-4eef-a353-d510f7c0f2f0', 'd515c534-270e-4e52-894a-260f081e2f11', 'ba7e47ce-65df-482a-8f28-1db9a43919e5'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:19 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:19 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating offline snapshot 070b242d-0ae8-4f71-b519-4f9968c05e8f of volume 32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed44059e-7c12-4b5b-9904-947eb28e6e9d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:20 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 Apr 24 15:37:20 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:20 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.513s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Deleted volume successfully. Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1c2c9901-5e8b-4f5d-a5a0-338e359c5f7d tempest-SnapshotsActionsTest-269800342 None] Lock "cinder-be4cef29-fd82-4728-a5a6-e860d2c4193d-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:20 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476" returned: 0 in 0.537s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:20 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f 1G Apr 24 15:37:20 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:21 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f 1G" returned: 0 in 0.608s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a49f87-820c-4195-833e-2994e4cdf476 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:21 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a49f87-820c-4195-833e-2994e4cdf476 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f Apr 24 15:37:21 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:21 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a49f87-820c-4195-833e-2994e4cdf476 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:21 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f is being set with open permissions: ugo+rw Apr 24 15:37:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:21 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f Apr 24 15:37:21 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:22 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f" returned: 0 in 0.463s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:22 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info Apr 24 15:37:22 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:22 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info" returned: 0 in 0.466s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:22 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info is being set with open permissions: ugo+rw Apr 24 15:37:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:22 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info Apr 24 15:37:22 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:23 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.info" returned: 0 in 0.496s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f8c7893e-c0a7-4c21-8b25-9402d3630889 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Create snapshot completed successfully Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (d6e5243e-dafa-4cff-887f-c6264176cac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03251fb1-1c1b-428b-b590-62e0007aa0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03251fb1-1c1b-428b-b590-62e0007aa0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786937386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a66c32-8856-4950-b24f-c5934b45e415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:24Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763f23b5-7cb8-4c54-a9fa-7629afdf885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763f23b5-7cb8-4c54-a9fa-7629afdf885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b053297-85f3-4939-b65d-788b14f4d432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b053297-85f3-4939-b65d-788b14f4d432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a66c32-8856-4950-b24f-c5934b45e415', 'volume_name': 'volume-84a66c32-8856-4950-b24f-c5934b45e415', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6039abd-90b0-466f-9b5a-26b690796ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6039abd-90b0-466f-9b5a-26b690796ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9774aaf-0219-4322-8e25-5d7f6c9e5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume 84a66c32-8856-4950-b24f-c5934b45e415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a66c32-8856-4950-b24f-c5934b45e415', 'volume_size': 1} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786937386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a66c32-8856-4950-b24f-c5934b45e415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:24Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume 84a66c32-8856-4950-b24f-c5934b45e415 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:24 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 1073741824 Apr 24 15:37:24 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (f00a02db-4340-41a9-873b-6bed93c1a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d8085b-1404-496e-9a22-cfa8d390e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d8085b-1404-496e-9a22-cfa8d390e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85887845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1ce839-a400-4d9e-996e-63b9f21f3e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83e3064-25fa-4129-b483-fc4cc27a5326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83e3064-25fa-4129-b483-fc4cc27a5326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495ef20c-7e25-438a-8ade-aeb0ebcdb2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495ef20c-7e25-438a-8ade-aeb0ebcdb2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1ce839-a400-4d9e-996e-63b9f21f3e73', 'volume_name': 'volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cbc2f9-fb8f-45a1-b94c-f2fe915ee900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cbc2f9-fb8f-45a1-b94c-f2fe915ee900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1f8c05-1581-4262-830d-2db4186602dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume 6a1ce839-a400-4d9e-996e-63b9f21f3e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73', 'volume_size': 1} Apr 24 15:37:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (faa5a6b9-7bee-4705-b91e-112fa51e0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e1968-c8eb-4978-985c-89e63c9dc7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e1968-c8eb-4978-985c-89e63c9dc7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026324884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed9afed-3851-4d41-bb7e-cb1fc88517dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e230e6-f9c1-461b-87f9-8ea30d4a9967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e230e6-f9c1-461b-87f9-8ea30d4a9967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413648d6-e44e-4172-b35f-d0f896e75f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413648d6-e44e-4172-b35f-d0f896e75f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed9afed-3851-4d41-bb7e-cb1fc88517dc', 'volume_name': 'volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e9213f-a0bc-4f0c-a056-2f6d670861dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e9213f-a0bc-4f0c-a056-2f6d670861dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceca9962-9c21-4f8b-baf5-48e836ba0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume aed9afed-3851-4d41-bb7e-cb1fc88517dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc', 'volume_size': 1} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:25 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 1073741824" returned: 0 in 0.825s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:25 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 Apr 24 15:37:25 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (9584657c-b220-4f39-b290-d7b3921b6d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481f15e-1292-4f10-90e4-0873893d9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481f15e-1292-4f10-90e4-0873893d9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177590496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea18682-79f9-42d9-b88b-83ddfb4fb5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b57f4e0-ea00-402e-93f9-910c96600095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b57f4e0-ea00-402e-93f9-910c96600095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dda218-6c50-4ced-86ed-e7e0e0ada023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dda218-6c50-4ced-86ed-e7e0e0ada023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea18682-79f9-42d9-b88b-83ddfb4fb5f0', 'volume_name': 'volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaef82-ec93-4d03-b240-7dc5e8278e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaef82-ec93-4d03-b240-7dc5e8278e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fcc2ba-6418-4da2-b4b5-b87fd04355d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume 6ea18682-79f9-42d9-b88b-83ddfb4fb5f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0', 'volume_size': 1} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (fd0cc7cf-68ba-4c2c-9eac-f3d0941a39ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb99439-e229-415d-91a9-3f6f05fde9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb99439-e229-415d-91a9-3f6f05fde9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668594495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802598de-2029-4a3b-8dd8-5a2d5b138379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:26Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487c83b-01d4-4944-8c7d-172868618a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487c83b-01d4-4944-8c7d-172868618a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5747006f-7a14-40ae-8930-9ba963f047cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5747006f-7a14-40ae-8930-9ba963f047cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802598de-2029-4a3b-8dd8-5a2d5b138379', 'volume_name': 'volume-802598de-2029-4a3b-8dd8-5a2d5b138379', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d75ed-1b7c-4488-82b6-55a62046356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d75ed-1b7c-4488-82b6-55a62046356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a55dea-3970-494b-b6c9-a43cee7f26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume 802598de-2029-4a3b-8dd8-5a2d5b138379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802598de-2029-4a3b-8dd8-5a2d5b138379', 'volume_size': 1} Apr 24 15:37:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:26 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415" returned: 0 in 0.596s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85887845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1ce839-a400-4d9e-996e-63b9f21f3e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume 6a1ce839-a400-4d9e-996e-63b9f21f3e73 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:26 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:26 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 1073741824 Apr 24 15:37:26 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9774aaf-0219-4322-8e25-5d7f6c9e5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a66c32-8856-4950-b24f-c5934b45e415', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901c9d90-e257-41ad-93a2-46741125ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-84a66c32-8856-4950-b24f-c5934b45e415 (84a66c32-8856-4950-b24f-c5934b45e415): created successfully Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901c9d90-e257-41ad-93a2-46741125ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (d6e5243e-dafa-4cff-887f-c6264176cac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-688af940-75db-49c6-a543-81a9b5caa531 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:26 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 1073741824" returned: 0 in 0.695s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:26 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 Apr 24 15:37:26 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:27 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73" returned: 0 in 0.527s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026324884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed9afed-3851-4d41-bb7e-cb1fc88517dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume aed9afed-3851-4d41-bb7e-cb1fc88517dc {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:27 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1f8c05-1581-4262-830d-2db4186602dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfebd5cb-23e3-4b2f-8a7b-b4691c8df7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:27 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc 1073741824 Apr 24 15:37:27 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:27 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 (6a1ce839-a400-4d9e-996e-63b9f21f3e73): created successfully Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfebd5cb-23e3-4b2f-8a7b-b4691c8df7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (f00a02db-4340-41a9-873b-6bed93c1a779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:27 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-53c8f6c1-a474-48a8-aa8b-6cd4b124a819 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:28 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc 1073741824" returned: 0 in 0.739s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:28 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc Apr 24 15:37:28 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:28 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc" returned: 0 in 0.475s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177590496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea18682-79f9-42d9-b88b-83ddfb4fb5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:25Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume 6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:28 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:28 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 1073741824 Apr 24 15:37:28 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceca9962-9c21-4f8b-baf5-48e836ba0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030251a8-c764-4323-a2a6-fb72aa1c9c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:28 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc (aed9afed-3851-4d41-bb7e-cb1fc88517dc): created successfully Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030251a8-c764-4323-a2a6-fb72aa1c9c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:28 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (faa5a6b9-7bee-4705-b91e-112fa51e0956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:28 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e44bab2c-0dbc-414f-a5a0-2b38a804250b tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:29 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 1073741824" returned: 0 in 0.718s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:29 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 Apr 24 15:37:29 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:29 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" returned: 0 in 0.483s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.977s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668594495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802598de-2029-4a3b-8dd8-5a2d5b138379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b03519a7ef048fc8a21789d1fdca395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:26Z,use_quota=True,user_id='4a19fa9d64c54ee99b999bc5a2d6f82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Creating volume 802598de-2029-4a3b-8dd8-5a2d5b138379 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:29 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:29 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 1073741824 Apr 24 15:37:29 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fcc2ba-6418-4da2-b4b5-b87fd04355d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e12ada0-bdaf-455e-ba00-ae9ef325d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 (6ea18682-79f9-42d9-b88b-83ddfb4fb5f0): created successfully Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e12ada0-bdaf-455e-ba00-ae9ef325d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (9584657c-b220-4f39-b290-d7b3921b6d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:29 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-551ec6ab-03b0-47f4-9fb9-ce71fe22c9ae tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (54d4dd8c-e9ae-49a8-9f5c-87166d22750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc4bab2-ded8-4905-8141-35e6a7d4724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc4bab2-ded8-4905-8141-35e6a7d4724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1961905439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:30Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f4c0bc-ebd5-4c53-8cad-1b3d34fff73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f4c0bc-ebd5-4c53-8cad-1b3d34fff73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e4633b-afb7-4ddf-a0a7-325e9b104b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e4633b-afb7-4ddf-a0a7-325e9b104b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02', 'volume_name': 'volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c40b51a-0c3e-4d58-ac5b-39216603ecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c40b51a-0c3e-4d58-ac5b-39216603ecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa16ba43-ffad-41d0-a682-1b05b508b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Volume 378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02', 'volume_size': 1} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:30 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 1073741824" returned: 0 in 0.677s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:30 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 Apr 24 15:37:30 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:31 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379" returned: 0 in 0.462s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1961905439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:30Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Creating volume 378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:31 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a55dea-3970-494b-b6c9-a43cee7f26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802598de-2029-4a3b-8dd8-5a2d5b138379', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:31 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 1073741824 Apr 24 15:37:31 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875f18ca-3d91-4837-8f57-ef2d40f21d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Volume volume-802598de-2029-4a3b-8dd8-5a2d5b138379 (802598de-2029-4a3b-8dd8-5a2d5b138379): created successfully Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875f18ca-3d91-4837-8f57-ef2d40f21d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Flow 'volume_create_manager' (fd0cc7cf-68ba-4c2c-9eac-f3d0941a39ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-177c9377-52d4-448e-ac3c-ceecbfbd35d4 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created volume successfully. Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-802598de-2029-4a3b-8dd8-5a2d5b138379-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-802598de-2029-4a3b-8dd8-5a2d5b138379-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-802598de-2029-4a3b-8dd8-5a2d5b138379" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-802598de-2029-4a3b-8dd8-5a2d5b138379" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c565ee-4833-4566-a542-9ba3cf234237]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:31 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 Apr 24 15:37:31 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:31 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 1073741824" returned: 0 in 0.633s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:31 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 Apr 24 15:37:31 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:32 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379" returned: 0 in 0.516s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:32 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379 Apr 24 15:37:32 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:32 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" returned: 0 in 0.418s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa16ba43-ffad-41d0-a682-1b05b508b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e30c5d1-0f4f-455a-8edb-283500e7b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Volume volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 (378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02): created successfully Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e30c5d1-0f4f-455a-8edb-283500e7b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (54d4dd8c-e9ae-49a8-9f5c-87166d22750e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d3f62081-c54e-4496-9aaf-11bdba6239d8 tempest-VolumesListAdminTestJSON-1777034733 None] Created volume successfully. Apr 24 15:37:32 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-802598de-2029-4a3b-8dd8-5a2d5b138379" returned: 0 in 0.466s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-802598de-2029-4a3b-8dd8-5a2d5b138379" released by "delete_volume" :: held 1.031s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['68e2e889-d8f9-4778-87e8-fb90990a3548', '88d393bd-ed5c-4f7d-9f8a-61edafc094f6', '9d1177f7-e19a-4f5b-8a02-75e1ee2e5d5d', '6e0881f4-06cb-4283-b166-0ecb3ad751e0'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:32 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:32 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (9e605fa7-e132-41df-a6b2-a746820fc3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b75912-7d57-40a0-aed7-534e926f8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b75912-7d57-40a0-aed7-534e926f8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046599840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89323f1c-fb19-4021-8cc8-ca1c1b646b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:33Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9e80bf-dd81-4657-a9f9-09ee8eb40967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9e80bf-dd81-4657-a9f9-09ee8eb40967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc8f1c0-57e3-47d5-afbb-a22d54315dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc8f1c0-57e3-47d5-afbb-a22d54315dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89323f1c-fb19-4021-8cc8-ca1c1b646b66', 'volume_name': 'volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af31e092-51b4-449d-8e80-7985701ab38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af31e092-51b4-449d-8e80-7985701ab38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09bec28-4511-4824-82a9-04752bc8f99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Volume 89323f1c-fb19-4021-8cc8-ca1c1b646b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66', 'volume_size': 1} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046599840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89323f1c-fb19-4021-8cc8-ca1c1b646b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:33Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Creating volume 89323f1c-fb19-4021-8cc8-ca1c1b646b66 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:32 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:32 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 1073741824 Apr 24 15:37:32 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:33 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.424s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-441090c2-b40d-4852-9686-a34dca42183f tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-802598de-2029-4a3b-8dd8-5a2d5b138379-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:33 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 1073741824" returned: 0 in 0.588s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:33 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 Apr 24 15:37:33 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e682a-9e51-4fb8-8ef4-4c8f28218aeb]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:33 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 Apr 24 15:37:33 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:33 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66" returned: 0 in 0.472s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09bec28-4511-4824-82a9-04752bc8f99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e396d-60f5-4dbd-9766-44d3e6ae5b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Volume volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 (89323f1c-fb19-4021-8cc8-ca1c1b646b66): created successfully Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e396d-60f5-4dbd-9766-44d3e6ae5b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (9e605fa7-e132-41df-a6b2-a746820fc3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:33 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a7ef4b31-1b57-4cea-b52a-333a0c27f294 tempest-VolumesListAdminTestJSON-1777034733 None] Created volume successfully. Apr 24 15:37:34 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" returned: 0 in 0.511s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:34 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0 Apr 24 15:37:34 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:34 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0" released by "delete_volume" :: held 0.979s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['88aa047b-90a6-41ac-9fef-984cab5074fe', '042705b5-994f-4efe-a77b-c1af94630cb2', '21d6719d-8b8d-45f5-add0-6e28041cc7ef', '44ef0fae-0daa-457a-8d2f-89cd658746df'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:34 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:34 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (230fafe2-128b-418e-910a-ed649dbb314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ab8c5a-d02b-485d-8c6f-48d884b60a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ab8c5a-d02b-485d-8c6f-48d884b60a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-212753228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1817fc4-4788-49f0-a257-26295bb9ea7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:35Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91470a24-9587-4127-a7ce-2b19f914b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:35 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91470a24-9587-4127-a7ce-2b19f914b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbb9899-67a0-442d-ac0b-4136a55db141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbb9899-67a0-442d-ac0b-4136a55db141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1817fc4-4788-49f0-a257-26295bb9ea7b', 'volume_name': 'volume-b1817fc4-4788-49f0-a257-26295bb9ea7b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53be9e20-fd63-41bd-b012-d902ddeaeae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53be9e20-fd63-41bd-b012-d902ddeaeae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d945bb2a-dbfd-403d-a200-bbc58eb4861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:35 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Volume b1817fc4-4788-49f0-a257-26295bb9ea7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1817fc4-4788-49f0-a257-26295bb9ea7b', 'volume_size': 1} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-212753228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1817fc4-4788-49f0-a257-26295bb9ea7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39060d8d926a42e59eae0d50c6253f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:35Z,use_quota=True,user_id='37672a2dc83b4e488604b30f6161647f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Creating volume b1817fc4-4788-49f0-a257-26295bb9ea7b {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:35 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.480s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:35 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b 1073741824 Apr 24 15:37:35 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-76692b92-e007-4b2f-abb5-2bf2a19e1a79 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-6ea18682-79f9-42d9-b88b-83ddfb4fb5f0-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-aed9afed-3851-4d41-bb7e-cb1fc88517dc-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:35 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-aed9afed-3851-4d41-bb7e-cb1fc88517dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b 1073741824" returned: 0 in 0.607s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-aed9afed-3851-4d41-bb7e-cb1fc88517dc" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:35 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-aed9afed-3851-4d41-bb7e-cb1fc88517dc" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:35 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b Apr 24 15:37:35 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e305e03d-8da0-45b4-a8f7-e09057db6d94]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:36 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc Apr 24 15:37:36 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:36 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b" returned: 0 in 0.452s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d945bb2a-dbfd-403d-a200-bbc58eb4861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1817fc4-4788-49f0-a257-26295bb9ea7b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f496298-618b-49ab-9f07-ae1809f38c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Volume volume-b1817fc4-4788-49f0-a257-26295bb9ea7b (b1817fc4-4788-49f0-a257-26295bb9ea7b): created successfully Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f496298-618b-49ab-9f07-ae1809f38c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Flow 'volume_create_manager' (230fafe2-128b-418e-910a-ed649dbb314b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1671e717-5242-4afe-876f-f54aa4173f8d tempest-VolumesListAdminTestJSON-1777034733 None] Created volume successfully. Apr 24 15:37:36 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc" returned: 0 in 0.526s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:36 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc Apr 24 15:37:36 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:36 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-aed9afed-3851-4d41-bb7e-cb1fc88517dc" returned: 0 in 0.413s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:36 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-aed9afed-3851-4d41-bb7e-cb1fc88517dc" released by "delete_volume" :: held 0.982s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['fd8661de-dae1-4029-8217-1c3ff9bd7099', '8d62d7ad-cb57-489c-a66b-8736178cc24b', '90a5dc76-9cd5-44da-8307-4341263d6a5e', '83e2d45f-98da-4f2c-bc65-6dc6e171bf5c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:37 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:37 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:37 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.426s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:37 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ea29e709-f022-4783-aea9-d21fe37ac958 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-aed9afed-3851-4d41-bb7e-cb1fc88517dc-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Flow 'volume_create_manager' (23826ea4-bb48-45e9-8249-daf0342f4b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3b5572-3bce-4ebe-9a7c-7924fac9dac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3b5572-3bce-4ebe-9a7c-7924fac9dac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51778711-c043-4810-84b9-c98836ebc2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8620e81b1c7b447c9e313d655c038925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:38Z,use_quota=True,user_id='c1afdc007a3e4a90a81062d58713f892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a93b73-ba19-4013-bc44-72144417407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a93b73-ba19-4013-bc44-72144417407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6a4dd-485a-4279-8d63-23e3a89010ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6a4dd-485a-4279-8d63-23e3a89010ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51778711-c043-4810-84b9-c98836ebc2f8', 'volume_name': 'volume-51778711-c043-4810-84b9-c98836ebc2f8', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93ba9d4-4344-4ea1-825f-3b6059099726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93ba9d4-4344-4ea1-825f-3b6059099726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae71152-ceb7-4f1f-9b31-281f635fd3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:37 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Volume 51778711-c043-4810-84b9-c98836ebc2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51778711-c043-4810-84b9-c98836ebc2f8', 'volume_size': 1} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51778711-c043-4810-84b9-c98836ebc2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8620e81b1c7b447c9e313d655c038925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:38Z,use_quota=True,user_id='c1afdc007a3e4a90a81062d58713f892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Creating volume 51778711-c043-4810-84b9-c98836ebc2f8 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:37 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:37 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 1073741824 Apr 24 15:37:37 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-6a1ce839-a400-4d9e-996e-63b9f21f3e73-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-6a1ce839-a400-4d9e-996e-63b9f21f3e73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-6a1ce839-a400-4d9e-996e-63b9f21f3e73" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-6a1ce839-a400-4d9e-996e-63b9f21f3e73" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9742ccbc-fb42-4f1d-b757-b24ad59cd206]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:38 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 Apr 24 15:37:38 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:38 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 1073741824" returned: 0 in 0.646s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:38 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 Apr 24 15:37:38 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:38 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73" returned: 0 in 0.540s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:38 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73 Apr 24 15:37:38 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:39 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8" returned: 0 in 0.515s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=133,cinder:UPDATE=154,cinder:INSERT=38,cinder:DELETE=11 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae71152-ceb7-4f1f-9b31-281f635fd3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51778711-c043-4810-84b9-c98836ebc2f8', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e8b08f-b2ad-48cf-8a83-1a22d80c27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=162,cinder:DELETE=18,cinder:INSERT=41,cinder:SELECT=121 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:37:39 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Volume volume-51778711-c043-4810-84b9-c98836ebc2f8 (51778711-c043-4810-84b9-c98836ebc2f8): created successfully Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e8b08f-b2ad-48cf-8a83-1a22d80c27cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Flow 'volume_create_manager' (23826ea4-bb48-45e9-8249-daf0342f4b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-aa6defcb-1da1-4d73-bcf9-23496c182406 tempest-VolumesListAdminTestJSON-81110931 None] Created volume successfully. Apr 24 15:37:39 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6a1ce839-a400-4d9e-996e-63b9f21f3e73" returned: 0 in 0.449s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-6a1ce839-a400-4d9e-996e-63b9f21f3e73" released by "delete_volume" :: held 1.039s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['6d8eb22f-e833-434b-8f8b-9ca42a8f03d8', '9e0bc43b-d863-475f-897c-6f4021a902ee', 'e27b17ee-19dd-42b4-9ad2-e96b3f4ff09e', 'fcc45931-eb96-4c29-8ffb-4903c061fe8b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:39 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:39 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:39 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.417s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:39 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-aa343ade-3300-4bcb-b518-4a89a5c8b616 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-6a1ce839-a400-4d9e-996e-63b9f21f3e73-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Acquiring lock "cinder-51778711-c043-4810-84b9-c98836ebc2f8-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "cinder-51778711-c043-4810-84b9-c98836ebc2f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Acquiring lock "cinder-quobyte-51778711-c043-4810-84b9-c98836ebc2f8" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "cinder-quobyte-51778711-c043-4810-84b9-c98836ebc2f8" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee42fe1-4322-4615-8816-c7e7b2a55fc6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-b1817fc4-4788-49f0-a257-26295bb9ea7b-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-b1817fc4-4788-49f0-a257-26295bb9ea7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 Apr 24 15:37:40 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-quobyte-b1817fc4-4788-49f0-a257-26295bb9ea7b" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-b1817fc4-4788-49f0-a257-26295bb9ea7b" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e85401e-3768-4fec-8741-fd76c0b9a7a4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-84a66c32-8856-4950-b24f-c5934b45e415-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-84a66c32-8856-4950-b24f-c5934b45e415-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b Apr 24 15:37:40 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-84a66c32-8856-4950-b24f-c5934b45e415" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-84a66c32-8856-4950-b24f-c5934b45e415" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e64ac-18f4-49ed-af7e-a7072e455414]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:40 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 Apr 24 15:37:40 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:40 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8" returned: 0 in 0.585s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:40 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8 Apr 24 15:37:40 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:40 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b" returned: 0 in 0.548s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:40 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b Apr 24 15:37:40 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:41 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:41 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415 Apr 24 15:37:41 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:41 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-51778711-c043-4810-84b9-c98836ebc2f8" returned: 0 in 0.440s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "cinder-quobyte-51778711-c043-4810-84b9-c98836ebc2f8" released by "delete_volume" :: held 1.061s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Created reservations ['65766e6b-b1de-4fa9-a9e2-650bce85d1ea', '0a353c69-69d7-41bc-bf74-3098f7622c9b', '07222b8c-69f8-4b0b-8ffb-10f36de5d625', '6f89a89f-c7d0-4bd8-831c-8841ea10bfd5'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:41 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b1817fc4-4788-49f0-a257-26295bb9ea7b" returned: 0 in 0.466s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-b1817fc4-4788-49f0-a257-26295bb9ea7b" released by "delete_volume" :: held 1.049s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:41 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-84a66c32-8856-4950-b24f-c5934b45e415" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-84a66c32-8856-4950-b24f-c5934b45e415" released by "delete_volume" :: held 0.998s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:41 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:41 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Created reservations ['d4669a2b-9633-412f-b864-bc3a44a3c36e', '67d8252d-fa36-4ab1-b32b-4bc7ea3beed5', 'd2a1f6f7-7cd6-468e-89ef-918f904ebbd9', '679ce045-30f5-4afb-a922-fb0faf2e19bf'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['8efd9a0f-c04f-4af1-a753-bf76de4069da', 'c1798511-6401-461f-8a91-c81b2b51c2f3', '88839bc3-91bb-43a9-8998-0034f74669ae', '9e5f235b-8302-4d3d-a7eb-b821bb740a39'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:42 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.418s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:42 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Deleted volume successfully. Apr 24 15:37:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f958f8f-cd33-433f-8542-02abfbe149bf tempest-VolumesListAdminTestJSON-81110931 None] Lock "cinder-51778711-c043-4810-84b9-c98836ebc2f8-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:46 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:46 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-070b242d-0ae8-4f71-b519-4f9968c05e8f-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-070b242d-0ae8-4f71-b519-4f9968c05e8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-070b242d-0ae8-4f71-b519-4f9968c05e8f" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-070b242d-0ae8-4f71-b519-4f9968c05e8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleting offline snapshot 070b242d-0ae8-4f71-b519-4f9968c05e8f of volume 32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] snapshot_file for this snap is: volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9181c363-f528-4bbc-9f58-5698fe10f439]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:46 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f Apr 24 15:37:46 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:46 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.424s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Deleted volume successfully. Apr 24 15:37:46 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f" returned: 0 in 0.503s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a49f87-820c-4195-833e-2994e4cdf476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6551d610-a8d3-4cfb-93d0-1a0d13a874e3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:46 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 Apr 24 15:37:46 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-89323f1c-fb19-4021-8cc8-ca1c1b646b66-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:46 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:46 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-9b8b8b40-1920-47f6-88f3-9966e259a23b tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-b1817fc4-4788-49f0-a257-26295bb9ea7b-delete_volume" released by "delete_volume" :: held 6.705s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-89323f1c-fb19-4021-8cc8-ca1c1b646b66-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-quobyte-89323f1c-fb19-4021-8cc8-ca1c1b646b66" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-89323f1c-fb19-4021-8cc8-ca1c1b646b66" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[171006fc-59c3-4920-9f05-365c1dd38611]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:47 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 Apr 24 15:37:47 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:47 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:47 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:47 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f Apr 24 15:37:47 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:47 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dbcbdc01-1a88-44c4-821b-6ea2a2efeea5 tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-84a66c32-8856-4950-b24f-c5934b45e415-delete_volume" released by "delete_volume" :: held 6.968s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:47 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66" returned: 0 in 0.522s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:47 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66 Apr 24 15:37:47 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:47 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f" returned: 0 in 0.540s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:47 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f Apr 24 15:37:47 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:48 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-89323f1c-fb19-4021-8cc8-ca1c1b646b66" returned: 0 in 0.471s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-89323f1c-fb19-4021-8cc8-ca1c1b646b66" released by "delete_volume" :: held 1.030s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Created reservations ['0c7ac86f-0990-4751-89b1-957fa72f67f3', 'e7da8a63-9d9f-4060-9b03-77a8dbeca368', 'dbaf9213-d6de-4ea6-b34a-45f18572fb48', '45e5939a-8661-4741-a90e-64bbded49cd7'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:48 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:48 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:48 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476.070b242d-0ae8-4f71-b519-4f9968c05e8f" returned: 0 in 0.447s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-070b242d-0ae8-4f71-b519-4f9968c05e8f" released by "_delete_snapshot" :: held 2.154s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" released by "delete_snapshot" :: held 2.181s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['ecd2e9a2-0e63-4614-8425-67a9beb5b2ef', '6655ec88-209f-49d0-b379-34a98aaf4da5', '369acb2d-f80e-4715-a8cd-4cf6a7118859', 'f53daffd-49fb-4d33-97a4-19fe1e001116'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Delete snapshot completed successfully. Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ae910742-4ae1-4019-a8e7-dc2b3b72b1cc tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-070b242d-0ae8-4f71-b519-4f9968c05e8f-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:48 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.494s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:48 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Deleted volume successfully. Apr 24 15:37:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7a56dd93-eef9-43e7-92df-e016a0f6255c tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-89323f1c-fb19-4021-8cc8-ca1c1b646b66-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:49 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:49 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "cinder-quobyte-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ce0522-d55e-40f8-a603-895d7bb3d4b3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-32a49f87-820c-4195-833e-2994e4cdf476-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-32a49f87-820c-4195-833e-2994e4cdf476-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:49 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 Apr 24 15:37:49 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeeb662-e3ca-4ff4-a64f-7d6478888ce6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:49 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.451s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:49 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 Apr 24 15:37:49 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:49 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" returned: 0 in 0.598s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:49 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02 Apr 24 15:37:49 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:49 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:50 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476 Apr 24 15:37:50 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:50 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-quobyte-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02" released by "delete_volume" :: held 1.076s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Created reservations ['6dd156f1-a6f7-4569-a13e-539caac5fcc7', '83b961db-32c1-43e8-88ce-8a7c3bf5e044', 'a75f1293-383d-415f-8253-bf7bcaa4742b', 'ab7ef618-ad8e-46a3-b888-23921f1fce8e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:50 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-32a49f87-820c-4195-833e-2994e4cdf476" returned: 0 in 0.448s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-quobyte-32a49f87-820c-4195-833e-2994e4cdf476" released by "delete_volume" :: held 1.023s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:50 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:50 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Created reservations ['8889b730-c0c0-48d4-9086-a78cb0b3a126', 'ae804432-b677-47d8-84e8-76b5b5b9cb15', 'c5de7abb-bbe7-4bff-a18a-2cb294a416aa', '4e248c8e-6d37-408f-ac2b-aa591ea7ed69'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:50 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:37:50 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:50 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.437s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Deleted volume successfully. Apr 24 15:37:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-076951d3-c716-45b5-821f-f8a5969563cd tempest-VolumesListAdminTestJSON-1777034733 None] Lock "cinder-378ed09a-89a1-4bf9-a4c6-ae9e3b35bb02-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:51 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.427s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:37:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Deleted volume successfully. Apr 24 15:37:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d1f7eec8-fc96-472d-9992-e54bd16591af tempest-CreateVolumesFromSnapshotTest-1941393720 None] Lock "cinder-32a49f87-820c-4195-833e-2994e4cdf476-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (dd3957ac-0612-43bc-a6fd-cc03e77cf739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab622b3d-33f1-492e-a412-bc6075a44514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab622b3d-33f1-492e-a412-bc6075a44514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400796152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34744b36-f837-4ee5-978c-65cfe0d5e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:54Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36918ddb-edc1-4595-ada3-a69b324491fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36918ddb-edc1-4595-ada3-a69b324491fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca6cc58-1182-469a-81ac-d060baab6d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca6cc58-1182-469a-81ac-d060baab6d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34744b36-f837-4ee5-978c-65cfe0d5e211', 'volume_name': 'volume-34744b36-f837-4ee5-978c-65cfe0d5e211', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfdc356-0e7d-4c5a-abd3-edc75489df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfdc356-0e7d-4c5a-abd3-edc75489df62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb78e60-52d7-4a65-aee2-268479201653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:54 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume 34744b36-f837-4ee5-978c-65cfe0d5e211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34744b36-f837-4ee5-978c-65cfe0d5e211', 'volume_size': 1} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400796152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34744b36-f837-4ee5-978c-65cfe0d5e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:54Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume 34744b36-f837-4ee5-978c-65cfe0d5e211 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:54 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:54 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 1073741824 Apr 24 15:37:54 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:55 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 1073741824" returned: 0 in 0.673s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:55 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 Apr 24 15:37:55 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:55 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211" returned: 0 in 0.533s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb78e60-52d7-4a65-aee2-268479201653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34744b36-f837-4ee5-978c-65cfe0d5e211', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567af6d-aaa4-483a-9ac2-dff04c2271e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:55 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-34744b36-f837-4ee5-978c-65cfe0d5e211 (34744b36-f837-4ee5-978c-65cfe0d5e211): created successfully Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567af6d-aaa4-483a-9ac2-dff04c2271e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (dd3957ac-0612-43bc-a6fd-cc03e77cf739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:55 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7f6d7b7b-c74d-4697-8ee0-04124060497e tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:37:56 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (97b0ef23-a388-461b-9e1f-abe7cb9e911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348606e0-5d5a-408d-8abd-2329874c5e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348606e0-5d5a-408d-8abd-2329874c5e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039003232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908461af-50c1-44d8-9208-10f1b67942ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:57Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48896349-ceeb-4b9c-9818-4ed550ca6e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48896349-ceeb-4b9c-9818-4ed550ca6e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137e01c8-5e3a-4554-a784-49f2d3f680f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137e01c8-5e3a-4554-a784-49f2d3f680f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908461af-50c1-44d8-9208-10f1b67942ff', 'volume_name': 'volume-908461af-50c1-44d8-9208-10f1b67942ff', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b5fe6b-aca7-4729-a084-f367f8e5b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b5fe6b-aca7-4729-a084-f367f8e5b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4cbfe6-06cf-466f-a89a-98be80fd1bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume 908461af-50c1-44d8-9208-10f1b67942ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908461af-50c1-44d8-9208-10f1b67942ff', 'volume_size': 1} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039003232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908461af-50c1-44d8-9208-10f1b67942ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:57Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume 908461af-50c1-44d8-9208-10f1b67942ff {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:57 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:57 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff 1073741824 Apr 24 15:37:57 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (a3009886-3aa3-42ee-bca1-67af594fdafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184ee45-8c4d-40fb-83e4-b20cba726ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184ee45-8c4d-40fb-83e4-b20cba726ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878330671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836527f-a1d2-4357-b0c8-487865040501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:57Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298224d9-b706-4dd5-959c-ebc972a96f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298224d9-b706-4dd5-959c-ebc972a96f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0830ef2d-8905-421a-a2db-b5cadc48428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0830ef2d-8905-421a-a2db-b5cadc48428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6836527f-a1d2-4357-b0c8-487865040501', 'volume_name': 'volume-6836527f-a1d2-4357-b0c8-487865040501', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30179bae-66e3-4215-ac57-95a655cbb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30179bae-66e3-4215-ac57-95a655cbb565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9920daba-e34f-4f50-addc-3dfd954918cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume 6836527f-a1d2-4357-b0c8-487865040501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6836527f-a1d2-4357-b0c8-487865040501', 'volume_size': 1} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (789c89a9-1845-4649-bc8d-3567d1aea42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b778aa-4823-4795-b27b-8dddcf931a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b778aa-4823-4795-b27b-8dddcf931a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638813241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8147688-937d-40ca-b631-7560f4e66a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb64cd5-6f83-493d-a967-af03f5d7a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb64cd5-6f83-493d-a967-af03f5d7a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf6dcfe-7de1-4d11-9b24-6554e0710708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf6dcfe-7de1-4d11-9b24-6554e0710708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8147688-937d-40ca-b631-7560f4e66a4b', 'volume_name': 'volume-f8147688-937d-40ca-b631-7560f4e66a4b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32700683-8268-4045-a910-77bb2e9d84d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32700683-8268-4045-a910-77bb2e9d84d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26865995-ec7c-45bb-afa1-670eed165db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume f8147688-937d-40ca-b631-7560f4e66a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8147688-937d-40ca-b631-7560f4e66a4b', 'volume_size': 1} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:57 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff 1073741824" returned: 0 in 0.846s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:57 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff Apr 24 15:37:57 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (65ed7711-239c-4301-962d-1b060fbc4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e657a1-5757-45ec-a6f2-7f0703c29e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e657a1-5757-45ec-a6f2-7f0703c29e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862536223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e8b6c1-abf6-460e-8a43-3428c853b886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23dfdc1-37c1-46c3-aa96-8b435fda61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23dfdc1-37c1-46c3-aa96-8b435fda61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d296e6-7cfc-496e-bafd-b126ea25ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d296e6-7cfc-496e-bafd-b126ea25ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e8b6c1-abf6-460e-8a43-3428c853b886', 'volume_name': 'volume-53e8b6c1-abf6-460e-8a43-3428c853b886', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf65c03-3a0f-4eb1-a57b-bc13e4212f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf65c03-3a0f-4eb1-a57b-bc13e4212f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c435b9-34f8-49fc-ad9e-946980b765be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume 53e8b6c1-abf6-460e-8a43-3428c853b886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e8b6c1-abf6-460e-8a43-3428c853b886', 'volume_size': 1} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (20e0a93c-738c-496e-8e4b-f876939a4290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f84af5b-ff02-44bd-95dd-1c593259fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f84af5b-ff02-44bd-95dd-1c593259fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432936294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96202f8f-05cd-4541-a622-5272bed3453d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5b423c-e663-49fc-b4c2-b18169276f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5b423c-e663-49fc-b4c2-b18169276f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba132ba-97f9-456d-b0ad-4e40febb9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba132ba-97f9-456d-b0ad-4e40febb9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96202f8f-05cd-4541-a622-5272bed3453d', 'volume_name': 'volume-96202f8f-05cd-4541-a622-5272bed3453d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c083bc-5ee6-4f0d-9fe6-869e6a082172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c083bc-5ee6-4f0d-9fe6-869e6a082172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b9f08-cfb4-437c-b629-e24770d1cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume 96202f8f-05cd-4541-a622-5272bed3453d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96202f8f-05cd-4541-a622-5272bed3453d', 'volume_size': 1} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff" returned: 0 in 0.569s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878330671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836527f-a1d2-4357-b0c8-487865040501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:57Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume 6836527f-a1d2-4357-b0c8-487865040501 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:58 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4cbfe6-06cf-466f-a89a-98be80fd1bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908461af-50c1-44d8-9208-10f1b67942ff', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebbf9e1-9870-4329-9fb0-bd8fdb9c2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:58 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 1073741824 Apr 24 15:37:58 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:58 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-908461af-50c1-44d8-9208-10f1b67942ff (908461af-50c1-44d8-9208-10f1b67942ff): created successfully Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebbf9e1-9870-4329-9fb0-bd8fdb9c2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (97b0ef23-a388-461b-9e1f-abe7cb9e911e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-79ba2240-6cee-4f67-94b1-d35a7af687a8 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:37:59 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 1073741824" returned: 0 in 0.783s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:59 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 Apr 24 15:37:59 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:59 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501" returned: 0 in 0.438s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.985s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638813241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8147688-937d-40ca-b631-7560f4e66a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume f8147688-937d-40ca-b631-7560f4e66a4b {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:37:59 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:37:59 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b 1073741824 Apr 24 15:37:59 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9920daba-e34f-4f50-addc-3dfd954918cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6836527f-a1d2-4357-b0c8-487865040501', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4080ec4-b675-4eaa-b503-d8a45d68227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:37:59 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-6836527f-a1d2-4357-b0c8-487865040501 (6836527f-a1d2-4357-b0c8-487865040501): created successfully Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4080ec4-b675-4eaa-b503-d8a45d68227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:37:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (a3009886-3aa3-42ee-bca1-67af594fdafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:37:59 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4e03743c-50b1-41e5-8e9b-b939a67ead80 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:38:00 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b 1073741824" returned: 0 in 0.752s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:00 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b Apr 24 15:38:00 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:01 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.062s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862536223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e8b6c1-abf6-460e-8a43-3428c853b886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume 53e8b6c1-abf6-460e-8a43-3428c853b886 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:01 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26865995-ec7c-45bb-afa1-670eed165db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8147688-937d-40ca-b631-7560f4e66a4b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6ee8e8-6342-4621-a0da-1c4e7b84d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:01 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 1073741824 Apr 24 15:38:01 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:01 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-f8147688-937d-40ca-b631-7560f4e66a4b (f8147688-937d-40ca-b631-7560f4e66a4b): created successfully Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6ee8e8-6342-4621-a0da-1c4e7b84d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (789c89a9-1845-4649-bc8d-3567d1aea42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:01 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-963ccfc7-3966-4d3d-8904-c071c18691c4 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:38:01 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 1073741824" returned: 0 in 0.807s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:02 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 Apr 24 15:38:02 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:02 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886" returned: 0 in 0.487s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.021s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432936294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96202f8f-05cd-4541-a622-5272bed3453d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04234da28a43dc88b0dc3d63bae046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:37:58Z,use_quota=True,user_id='1e97fbd4777645948422160322336d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Creating volume 96202f8f-05cd-4541-a622-5272bed3453d {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:02 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c435b9-34f8-49fc-ad9e-946980b765be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e8b6c1-abf6-460e-8a43-3428c853b886', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:02 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d 1073741824 Apr 24 15:38:02 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38afe674-daf2-4657-aaf6-f24cbd3f9156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:02 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-53e8b6c1-abf6-460e-8a43-3428c853b886 (53e8b6c1-abf6-460e-8a43-3428c853b886): created successfully Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38afe674-daf2-4657-aaf6-f24cbd3f9156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (65ed7711-239c-4301-962d-1b060fbc4048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e96a4171-560b-4269-8813-04d0b59fb1ae tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:38:03 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d 1073741824" returned: 0 in 0.685s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:03 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d Apr 24 15:38:03 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:03 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d" returned: 0 in 0.500s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b9f08-cfb4-437c-b629-e24770d1cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96202f8f-05cd-4541-a622-5272bed3453d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7318921c-413f-4b87-aae9-cf0bbc557d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:03 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Volume volume-96202f8f-05cd-4541-a622-5272bed3453d (96202f8f-05cd-4541-a622-5272bed3453d): created successfully Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7318921c-413f-4b87-aae9-cf0bbc557d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Flow 'volume_create_manager' (20e0a93c-738c-496e-8e4b-f876939a4290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:03 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-52dc7286-76aa-4fbf-8e56-2895a89a8176 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created volume successfully. Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-96202f8f-05cd-4541-a622-5272bed3453d-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-96202f8f-05cd-4541-a622-5272bed3453d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-96202f8f-05cd-4541-a622-5272bed3453d" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-96202f8f-05cd-4541-a622-5272bed3453d" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc6c64-4eb6-413f-a45f-b325de5580a1]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:04 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d Apr 24 15:38:04 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Flow 'volume_create_manager' (b6840aa4-0912-4cc6-af72-0e8c7109d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260f01b9-853e-4c49-88f8-590ff07b6ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260f01b9-853e-4c49-88f8-590ff07b6ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-988363630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e91cd048e14341b630d54bc5177296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:04Z,use_quota=True,user_id='959bf8d041f44398b937fa36103c5f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf40f51-2cd0-4509-9c93-ef376d070700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf40f51-2cd0-4509-9c93-ef376d070700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17778e00-41dc-434a-9f92-c722b22b48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17778e00-41dc-434a-9f92-c722b22b48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1', 'volume_name': 'volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3f5d4b-9a21-4ce1-9e01-fa469b04f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3f5d4b-9a21-4ce1-9e01-fa469b04f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20b977f-852d-4efd-bf7a-5cee8116c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Volume c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1', 'volume_size': 1} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-988363630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e91cd048e14341b630d54bc5177296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:04Z,use_quota=True,user_id='959bf8d041f44398b937fa36103c5f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Creating volume c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:04 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:04 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 1073741824 Apr 24 15:38:04 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:04 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:04 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d Apr 24 15:38:04 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:05 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 1073741824" returned: 0 in 0.601s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:05 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 Apr 24 15:38:05 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:05 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-96202f8f-05cd-4541-a622-5272bed3453d" returned: 0 in 0.453s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-96202f8f-05cd-4541-a622-5272bed3453d" released by "delete_volume" :: held 1.018s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['a996c5f4-3704-49c5-9697-ee83d7a53ae3', '4a94c7e1-25a1-4044-9fb5-863ee444d79e', 'b221def8-de85-4d07-b761-ef95d78a3676', 'b36e33a4-955d-4c34-9b5c-e5a14ac2b4ea'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:05 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:05 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:05 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" returned: 0 in 0.495s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20b977f-852d-4efd-bf7a-5cee8116c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d416ef-1c6e-4242-b10d-aadab7488769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:05 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Volume volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 (c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1): created successfully Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d416ef-1c6e-4242-b10d-aadab7488769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Flow 'volume_create_manager' (b6840aa4-0912-4cc6-af72-0e8c7109d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:05 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-cea82376-ab25-48d9-a348-27e02b073d5b tempest-VolumesTransfersV355Test-2035924039 None] Created volume successfully. Apr 24 15:38:05 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.450s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:05 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-865e7335-c961-4dcd-9f86-370ee5e6a01f tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-96202f8f-05cd-4541-a622-5272bed3453d-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-53e8b6c1-abf6-460e-8a43-3428c853b886-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-53e8b6c1-abf6-460e-8a43-3428c853b886-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-53e8b6c1-abf6-460e-8a43-3428c853b886" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-53e8b6c1-abf6-460e-8a43-3428c853b886" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cedaeb-81bc-4164-9d88-e7789c04148a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:06 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 Apr 24 15:38:06 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:06 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:06 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886 Apr 24 15:38:06 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5e7bb404-87f3-4374-9a53-029ac1d455f5 tempest-VolumesTransfersV355Test-165136423 None] Transfer volume completed successfully. Apr 24 15:38:07 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-53e8b6c1-abf6-460e-8a43-3428c853b886" returned: 0 in 0.438s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-53e8b6c1-abf6-460e-8a43-3428c853b886" released by "delete_volume" :: held 1.035s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['215dc31d-fea8-4829-8a4f-26cc46c31f8e', '7165375f-c396-46fd-ae57-1d465f3567da', '969ef9b2-8b32-4316-b926-318580fe6b4e', 'd378f811-f847-411c-a8ff-62f2eb3da1e6'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:07 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:07 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "cinder-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "cinder-quobyte-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-quobyte-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:08 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4edaf-0b65-451d-a4f0-d8eb7fa0fee5]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e143b330-96ba-4fca-9aa4-a9db83714abd tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-53e8b6c1-abf6-460e-8a43-3428c853b886-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:08 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 Apr 24 15:38:08 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-f8147688-937d-40ca-b631-7560f4e66a4b-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-f8147688-937d-40ca-b631-7560f4e66a4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:08 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" returned: 0 in 0.555s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:08 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1 Apr 24 15:38:08 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-f8147688-937d-40ca-b631-7560f4e66a4b" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-f8147688-937d-40ca-b631-7560f4e66a4b" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc96a35-6d52-41af-b1aa-17022e396429]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:08 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b Apr 24 15:38:08 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:09 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" returned: 0 in 0.442s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-quobyte-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1" released by "delete_volume" :: held 1.071s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Created reservations ['58ccc89c-c10f-44df-8353-bbbf59eb0ca0', 'b532d651-5f63-444b-90eb-44cfa369577c', '5692e785-deb3-4268-9606-d5939e501e8c', '100c7614-72ac-4885-9209-690c16e6ca1c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:09 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:09 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:09 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b" returned: 0 in 0.548s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:09 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b Apr 24 15:38:09 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:09 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.446s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Deleted volume successfully. Apr 24 15:38:09 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-f8147688-937d-40ca-b631-7560f4e66a4b" returned: 0 in 0.457s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-f8147688-937d-40ca-b631-7560f4e66a4b" released by "delete_volume" :: held 1.042s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36913d1e-517e-49f2-930d-225dfd31216c tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-c617f4f4-d3f6-47de-8dd6-2ef5c32f73b1-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['d969d582-0078-4b0d-8ad4-1a79a4c66af6', '693e2018-f3e0-4fe1-90dc-c06a4d4e444c', '6609e41a-4dbe-4220-b234-b5128a162683', '561b21d2-b340-4c30-a6d7-207bb57c4cfe'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:09 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:09 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:10 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.454s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:10 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-4fdf7a50-567b-49c3-839e-254844b9ca40 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-f8147688-937d-40ca-b631-7560f4e66a4b-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-6836527f-a1d2-4357-b0c8-487865040501-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-6836527f-a1d2-4357-b0c8-487865040501-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-6836527f-a1d2-4357-b0c8-487865040501" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-6836527f-a1d2-4357-b0c8-487865040501" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f131c2-9d4f-42e9-99f9-c4a224b47d99]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:12 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 Apr 24 15:38:12 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:12 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501" returned: 0 in 0.514s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:12 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501 Apr 24 15:38:12 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:13 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6836527f-a1d2-4357-b0c8-487865040501" returned: 0 in 0.443s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-6836527f-a1d2-4357-b0c8-487865040501" released by "delete_volume" :: held 0.999s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['87c1150d-f32b-4aa8-acec-ce1ef2ce7d4b', 'b765af32-8e11-4d2c-9a44-b7f5326e6de7', 'ff184c1b-f1e4-4ebe-82b4-4b6fb42ff2c3', '4d9fd0f6-8d45-47a3-8eb4-8a892139cb82'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Flow 'volume_create_manager' (6dfbc8f4-3cd8-498c-bee2-bf053f3bb9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a208003d-9ada-4988-8a2a-f87d343dc36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a208003d-9ada-4988-8a2a-f87d343dc36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994717468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f3b14-e2e1-41e1-bd72-ec0dbc27ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e91cd048e14341b630d54bc5177296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:13Z,use_quota=True,user_id='959bf8d041f44398b937fa36103c5f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc9cbb4-8640-4c48-b9ec-2a64555f6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc9cbb4-8640-4c48-b9ec-2a64555f6eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c810c-99b3-44a1-8e89-83a18e845af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c810c-99b3-44a1-8e89-83a18e845af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164f3b14-e2e1-41e1-bd72-ec0dbc27ea69', 'volume_name': 'volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c11c0c8-b018-40d9-8379-800e971fe1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c11c0c8-b018-40d9-8379-800e971fe1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef969a-0c14-4795-ac85-c1c85816e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:14 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Volume 164f3b14-e2e1-41e1-bd72-ec0dbc27ea69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69', 'volume_size': 1} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994717468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f3b14-e2e1-41e1-bd72-ec0dbc27ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e91cd048e14341b630d54bc5177296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:13Z,use_quota=True,user_id='959bf8d041f44398b937fa36103c5f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Creating volume 164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:14 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:15 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 1073741824 Apr 24 15:38:15 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:15 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 1073741824" returned: 0 in 0.651s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:15 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:15 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:16 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-908461af-50c1-44d8-9208-10f1b67942ff-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-45f3fc73-14d1-4a9f-9bef-7d70e6a52e92 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-6836527f-a1d2-4357-b0c8-487865040501-delete_volume" released by "delete_volume" :: held 4.850s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-908461af-50c1-44d8-9208-10f1b67942ff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:16 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 Apr 24 15:38:16 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-908461af-50c1-44d8-9208-10f1b67942ff" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-908461af-50c1-44d8-9208-10f1b67942ff" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[db931993-246c-48fb-a267-5b0dcac81224]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:16 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff Apr 24 15:38:16 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:16 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" returned: 0 in 0.452s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef969a-0c14-4795-ac85-c1c85816e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3977b3-fe08-46eb-a63d-08165b1bfbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:16 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Volume volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 (164f3b14-e2e1-41e1-bd72-ec0dbc27ea69): created successfully Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3977b3-fe08-46eb-a63d-08165b1bfbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Flow 'volume_create_manager' (6dfbc8f4-3cd8-498c-bee2-bf053f3bb9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8bf576bc-8590-4828-bf4c-9eb73bdd9ea5 tempest-VolumesTransfersV355Test-2035924039 None] Created volume successfully. Apr 24 15:38:17 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:17 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff Apr 24 15:38:17 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:17 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-908461af-50c1-44d8-9208-10f1b67942ff" returned: 0 in 0.426s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-908461af-50c1-44d8-9208-10f1b67942ff" released by "delete_volume" :: held 0.996s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['967cfb7b-1e72-4098-83c1-63b108699afb', 'b03e6490-6e5f-430b-880f-b792b2931f84', '12127b5c-03fa-4ac0-a504-3157044370d4', '8b568032-8e9b-4a4e-9171-b12a630feb9c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:17 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:17 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "cinder-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "cinder-quobyte-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-quobyte-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1cdf4-c4ca-4c49-96de-8d49958b5d2e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:18 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 Apr 24 15:38:18 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:18 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.484s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8056be5f-8064-4e86-9c6a-97823397d8c5 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-908461af-50c1-44d8-9208-10f1b67942ff-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:18 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" returned: 0 in 0.492s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:18 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69 Apr 24 15:38:18 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-34744b36-f837-4ee5-978c-65cfe0d5e211-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-34744b36-f837-4ee5-978c-65cfe0d5e211-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "cinder-quobyte-34744b36-f837-4ee5-978c-65cfe0d5e211" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-34744b36-f837-4ee5-978c-65cfe0d5e211" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe557cbd-89b0-47d2-bc09-386daffbda0e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:18 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 Apr 24 15:38:18 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:18 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" returned: 0 in 0.436s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-quobyte-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69" released by "delete_volume" :: held 0.982s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:18 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Created reservations ['f5b6336e-b091-4fa3-9cd8-b19d50164520', 'a597407d-a855-4c85-aa02-cd5033335a33', 'e474290b-49ed-43cb-8262-787475c43e60', 'f9e7ab81-9b17-4b56-92ed-c31c6f93d053'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:19 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:19 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:19 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211" returned: 0 in 0.588s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:19 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211 Apr 24 15:38:19 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:19 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.509s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Deleted volume successfully. Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-dad54f27-09b3-4246-91d4-9eb056a06766 tempest-VolumesTransfersV355Test-1906334232 None] Lock "cinder-164f3b14-e2e1-41e1-bd72-ec0dbc27ea69-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:19 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-34744b36-f837-4ee5-978c-65cfe0d5e211" returned: 0 in 0.531s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-quobyte-34744b36-f837-4ee5-978c-65cfe0d5e211" released by "delete_volume" :: held 1.157s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Created reservations ['e9b051d5-9d38-4890-a396-71122c37e417', 'df7ceae3-bbf6-4ede-87c0-9ad7d031ce01', 'd579d694-41f8-4119-b498-6a8ff1dc28df', 'c73fbb38-3f40-42c6-b089-7ba6fbbc5b9d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:19 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:19 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:20 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.475s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:20 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Deleted volume successfully. Apr 24 15:38:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7b2bd349-e6ea-4d5b-9e36-169243234a56 tempest-CreateVolumesFromSourceVolumeTest-1755878549 None] Lock "cinder-34744b36-f837-4ee5-978c-65cfe0d5e211-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (b65bd790-64d0-4025-9065-6bd292eb493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbaa873-35f4-4c94-9240-44adb471ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbaa873-35f4-4c94-9240-44adb471ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-825751968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d109e89f-9c34-48d3-96aa-a9f846e7eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:23Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92554dac-628e-458f-b903-81a01542bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92554dac-628e-458f-b903-81a01542bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6dd002d-b675-4fbc-83a2-f4a49d028565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6dd002d-b675-4fbc-83a2-f4a49d028565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd109e89f-9c34-48d3-96aa-a9f846e7eb98', 'volume_name': 'volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b38e99-4930-4bc1-9108-bf656658bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b38e99-4930-4bc1-9108-bf656658bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded9e0f2-bda5-4f53-9e8b-09345f1ef760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Volume d109e89f-9c34-48d3-96aa-a9f846e7eb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98', 'volume_size': 1} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-825751968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d109e89f-9c34-48d3-96aa-a9f846e7eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:23Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Creating volume d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:23 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:23 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 1073741824 Apr 24 15:38:23 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Flow 'volume_create_manager' (a398739c-6f82-4c11-945f-d08b96bf52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ba438-3646-4f45-92c1-1d8485941ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ba438-3646-4f45-92c1-1d8485941ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-519274764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17785e6c-e8da-4424-a246-a15cbe902104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68733a96ab5431dbf93b1d578470b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:24Z,use_quota=True,user_id='3e188a48087348ac9075035362345795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09bcb3b-724c-4851-960a-63297ab48b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09bcb3b-724c-4851-960a-63297ab48b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf115ea-f103-4dc5-81d0-a6c4c04675d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf115ea-f103-4dc5-81d0-a6c4c04675d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17785e6c-e8da-4424-a246-a15cbe902104', 'volume_name': 'volume-17785e6c-e8da-4424-a246-a15cbe902104', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78ef06-de33-4933-9919-a26303195b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78ef06-de33-4933-9919-a26303195b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa3b83f-d46d-45e8-8e20-25d2bdaaab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Volume 17785e6c-e8da-4424-a246-a15cbe902104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17785e6c-e8da-4424-a246-a15cbe902104', 'volume_size': 1} Apr 24 15:38:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:24 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 1073741824" returned: 0 in 0.595s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:24 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:24 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:24 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.413s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-519274764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17785e6c-e8da-4424-a246-a15cbe902104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68733a96ab5431dbf93b1d578470b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:24Z,use_quota=True,user_id='3e188a48087348ac9075035362345795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Creating volume 17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:24 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 1073741824 Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded9e0f2-bda5-4f53-9e8b-09345f1ef760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:24 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29fc69f-4a57-4e40-b72b-7cacd0950aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Volume volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 (d109e89f-9c34-48d3-96aa-a9f846e7eb98): created successfully Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29fc69f-4a57-4e40-b72b-7cacd0950aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (b65bd790-64d0-4025-9065-6bd292eb493a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-005a526e-9a58-4b97-8da9-60ed7b5804aa tempest-VolumeDependencyTests-2104325514 None] Created volume successfully. Apr 24 15:38:25 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 1073741824" returned: 0 in 0.603s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:25 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:25 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:25 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 0.478s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa3b83f-d46d-45e8-8e20-25d2bdaaab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17785e6c-e8da-4424-a246-a15cbe902104', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68911f26-5f95-4390-890d-e327b3eecb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Volume volume-17785e6c-e8da-4424-a246-a15cbe902104 (17785e6c-e8da-4424-a246-a15cbe902104): created successfully Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68911f26-5f95-4390-890d-e327b3eecb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Flow 'volume_create_manager' (a398739c-6f82-4c11-945f-d08b96bf52fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9053d38f-319d-42de-8869-ec255b659cb5 tempest-VolumesCloneTest-43953975 None] Created volume successfully. Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Creating offline snapshot d93f4901-9309-45c8-9d60-87e33ee1a6f9 of volume d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[da05e1ac-b3a5-4fce-9c48-e89d5b14af2a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:26 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:26 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:26 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.513s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:26 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 1G Apr 24 15:38:26 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:27 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 1G" returned: 0 in 0.568s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:27 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:27 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Flow 'volume_create_manager' (9414e1d4-b378-4cea-941f-f9c483bc8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26854e6-2849-4760-a21a-9ca67943bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26854e6-2849-4760-a21a-9ca67943bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-237360860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e224a5-7ade-4b5f-909c-4c3cc992dd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68733a96ab5431dbf93b1d578470b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=17785e6c-e8da-4424-a246-a15cbe902104,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:27Z,use_quota=True,user_id='3e188a48087348ac9075035362345795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb718d-7383-4ef2-9422-0fd0528cf826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb718d-7383-4ef2-9422-0fd0528cf826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f18eb3-aa76-4edc-b818-b25f374c1ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f18eb3-aa76-4edc-b818-b25f374c1ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '90e224a5-7ade-4b5f-909c-4c3cc992dd72', 'volume_name': 'volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72', 'volume_size': 2, 'source_volid': '17785e6c-e8da-4424-a246-a15cbe902104', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce94441-3281-4adf-9be8-e043fa66dde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce94441-3281-4adf-9be8-e043fa66dde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fab07c-b880-45a3-a77f-449aed4ac862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:27 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Volume 90e224a5-7ade-4b5f-909c-4c3cc992dd72: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72', 'volume_size': 2, 'source_volid': '17785e6c-e8da-4424-a246-a15cbe902104', 'source_volstatus': 'available'} Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:27 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.594s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:27 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 is being set with open permissions: ugo+rw Apr 24 15:38:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:27 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:27 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:28 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.436s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:28 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info Apr 24 15:38:28 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:28 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info" returned: 0 in 0.447s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:28 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info is being set with open permissions: ugo+rw Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:28 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info Apr 24 15:38:28 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:28 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.info" returned: 0 in 0.434s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.073s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.549s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:28 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Cloning volume 17785e6c-e8da-4424-a246-a15cbe902104 to volume 90e224a5-7ade-4b5f-909c-4c3cc992dd72 Apr 24 15:38:29 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-15d37ef0-f8cf-4e6e-a9c6-799a4c070ded tempest-VolumeDependencyTests-2104325514 None] Create snapshot completed successfully Apr 24 15:38:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Creating offline snapshot 83913aae-b1c8-4385-8f53-912c1421eece of volume 17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:38:29 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[137eecd0-2ec4-4491-a675-32237fad998a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:29 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:29 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:29 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:29 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece 1G Apr 24 15:38:29 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:30 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece 1G" returned: 0 in 0.647s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17785e6c-e8da-4424-a246-a15cbe902104 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:30 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17785e6c-e8da-4424-a246-a15cbe902104 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:30 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (5eda8f49-681b-477d-9bc6-1c6e6cc9be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54338dd-c501-4450-8c71-09d2e66a225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54338dd-c501-4450-8c71-09d2e66a225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-479279930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e92a13e-68b4-4779-bcbf-a92deb6b924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d93f4901-9309-45c8-9d60-87e33ee1a6f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:30Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057cf3f-3976-420b-b4f5-16f644cc8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057cf3f-3976-420b-b4f5-16f644cc8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f672e47b-9636-4011-9e30-4e06e2810c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f672e47b-9636-4011-9e30-4e06e2810c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e92a13e-68b4-4779-bcbf-a92deb6b924a', 'volume_name': 'volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a', 'volume_size': 1, 'snapshot_id': 'd93f4901-9309-45c8-9d60-87e33ee1a6f9'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b769dc83-a554-4701-ae8a-b0e0d012e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b769dc83-a554-4701-ae8a-b0e0d012e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053601cf-97ff-4e72-b757-6a7171644d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Volume 0e92a13e-68b4-4779-bcbf-a92deb6b924a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a', 'volume_size': 1, 'snapshot_id': 'd93f4901-9309-45c8-9d60-87e33ee1a6f9'} Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:30 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17785e6c-e8da-4424-a246-a15cbe902104 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.514s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:30 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece is being set with open permissions: ugo+rw Apr 24 15:38:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:30 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:30 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:31 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.486s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:31 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info Apr 24 15:38:31 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:31 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:31 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info is being set with open permissions: ugo+rw Apr 24 15:38:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:31 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info Apr 24 15:38:31 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:32 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.info" returned: 0 in 0.456s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] snapshot: 83913aae-b1c8-4385-8f53-912c1421eece, volume: 90e224a5-7ade-4b5f-909c-4c3cc992dd72, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d19d8a-3c2c-41fa-b133-5067527ba9a4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:32 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:32 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:32 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.539s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17785e6c-e8da-4424-a246-a15cbe902104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6cbe58-d91a-4322-8632-aca17ec54247]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:32 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:32 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:33 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 0.525s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:33 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:38:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:33 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 Apr 24 15:38:33 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:37 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72" returned: 0 in 4.221s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:37 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e8f05-4c95-4c83-bcb1-b415aabcc273]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:37 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:37 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:38 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 0.628s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:38:38 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Converted 1024.00 MB image at 242.51 MB/s Apr 24 15:38:38 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 is being set with open permissions: ugo+rw Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:38 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 Apr 24 15:38:38 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:38 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72" returned: 0 in 0.409s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" released by "_copy_volume_from_snapshot" :: held 6.404s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-quobyte-83913aae-b1c8-4385-8f53-912c1421eece" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-83913aae-b1c8-4385-8f53-912c1421eece" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Deleting offline snapshot 83913aae-b1c8-4385-8f53-912c1421eece of volume 17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] snapshot_file for this snap is: volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[49994434-4844-4234-83d6-f23bc4f2aa2a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:38 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:38 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:39 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.502s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17785e6c-e8da-4424-a246-a15cbe902104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b1a62f-8c34-4b6f-83f4-8bc32c04df33]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:39 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:39 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:39 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 0.496s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:39 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:39 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:40 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.511s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:40 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece Apr 24 15:38:40 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:40 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104.83913aae-b1c8-4385-8f53-912c1421eece" returned: 0 in 0.410s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-83913aae-b1c8-4385-8f53-912c1421eece" released by "_delete_snapshot" :: held 2.012s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=149,cinder:DELETE=15,cinder:SELECT=112,cinder:INSERT=43 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=106,cinder:INSERT=34,cinder:UPDATE=171,cinder:DELETE=12 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.687s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.123s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9-0e92a13e-68b4-4779-bcbf-a92deb6b924a" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fab07c-b880-45a3-a77f-449aed4ac862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72', 'volume_size': 2, 'source_volid': '17785e6c-e8da-4424-a246-a15cbe902104', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c513b4-685e-4ce2-b84f-e0a03c22e0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9-0e92a13e-68b4-4779-bcbf-a92deb6b924a" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Creating volume 0e92a13e-68b4-4779-bcbf-a92deb6b924a from snapshot d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:40 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Volume volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 (90e224a5-7ade-4b5f-909c-4c3cc992dd72): created successfully Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c513b4-685e-4ce2-b84f-e0a03c22e0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Flow 'volume_create_manager' (9414e1d4-b378-4cea-941f-f9c483bc8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] snapshot: d93f4901-9309-45c8-9d60-87e33ee1a6f9, volume: 0e92a13e-68b4-4779-bcbf-a92deb6b924a, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:40 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1e512f89-5411-4730-bc80-594cb42fc4d3 tempest-VolumesCloneTest-43953975 None] Created volume successfully. Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[85615daf-979d-4685-b632-f0ac374abc46]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:40 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:40 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-90e224a5-7ade-4b5f-909c-4c3cc992dd72-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "cinder-90e224a5-7ade-4b5f-909c-4c3cc992dd72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:41 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.575s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f7ffe-8f54-4b44-af9a-5b8f87a8eba1]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a069bb-73a5-464e-9354-a5e34e3f0bb4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:41 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:41 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:41 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 Apr 24 15:38:41 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:41 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:41 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a Apr 24 15:38:41 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:41 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72" returned: 0 in 0.542s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:42 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72 Apr 24 15:38:42 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:42 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-90e224a5-7ade-4b5f-909c-4c3cc992dd72" returned: 0 in 0.496s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-90e224a5-7ade-4b5f-909c-4c3cc992dd72" released by "delete_volume" :: held 1.082s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Created reservations ['464ce549-46b9-4c5d-82ca-1fb7a6416583', '73320457-173d-422c-b0b4-027f6f4e432d', '99dda16b-c51c-436e-a3c0-8e21eea72928', '0333a112-8f6e-4984-8875-fe055a757cb6'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:42 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:42 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:43 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.915s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:43 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Deleted volume successfully. Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d517ce49-e232-4267-a4eb-917268a7d53d tempest-VolumesCloneTest-43953975 None] Lock "cinder-90e224a5-7ade-4b5f-909c-4c3cc992dd72-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-17785e6c-e8da-4424-a246-a15cbe902104-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "cinder-17785e6c-e8da-4424-a246-a15cbe902104-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Acquiring lock "cinder-quobyte-17785e6c-e8da-4424-a246-a15cbe902104" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-17785e6c-e8da-4424-a246-a15cbe902104" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:44 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16d82a-52d0-49e3-8835-2f7aba4f8282]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:44 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:44 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:45 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 1.134s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:45 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104 Apr 24 15:38:45 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:46 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17785e6c-e8da-4424-a246-a15cbe902104" returned: 0 in 1.118s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "cinder-quobyte-17785e6c-e8da-4424-a246-a15cbe902104" released by "delete_volume" :: held 2.382s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Created reservations ['24774dee-b84d-426b-905a-8e7e326a2e9b', 'a7eeefdc-cd88-4b82-bf06-3de4e1b776db', 'be312daa-76fe-4206-bfb6-a7c4cfe6e798', '864d896f-c6fc-47e9-8b4d-5c75fc5d2973'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:46 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:46 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:46 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a" returned: 0 in 4.791s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[47031b9b-d906-4892-a8ac-5ab88aff028d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:46 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:46 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:46 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.488s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Deleted volume successfully. Apr 24 15:38:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-90b92342-e0e6-4e7f-8344-d3ebf558aa29 tempest-VolumesCloneTest-43953975 None] Lock "cinder-17785e6c-e8da-4424-a246-a15cbe902104-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:47 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.683s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:38:47 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Converted 1024.00 MB image at 213.69 MB/s Apr 24 15:38:47 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a is being set with open permissions: ugo+rw Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:47 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a Apr 24 15:38:47 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:47 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a" returned: 0 in 0.484s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" released by "_copy_volume_from_snapshot" :: held 7.157s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9-0e92a13e-68b4-4779-bcbf-a92deb6b924a" released by "_create_volume_from_snapshot" :: held 7.201s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.230s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053601cf-97ff-4e72-b757-6a7171644d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a', 'volume_size': 1, 'snapshot_id': 'd93f4901-9309-45c8-9d60-87e33ee1a6f9'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d547fdd-bdf8-4ffa-9b38-23a2ed0da5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:47 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Volume volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a (0e92a13e-68b4-4779-bcbf-a92deb6b924a): created successfully Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d547fdd-bdf8-4ffa-9b38-23a2ed0da5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:47 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (5eda8f49-681b-477d-9bc6-1c6e6cc9be8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:47 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5e9b388c-926a-4650-94e6-ad0624ae1cd1 tempest-VolumeDependencyTests-2104325514 None] Created volume successfully. Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-d93f4901-9309-45c8-9d60-87e33ee1a6f9-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-d93f4901-9309-45c8-9d60-87e33ee1a6f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Deleting offline snapshot d93f4901-9309-45c8-9d60-87e33ee1a6f9 of volume d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] snapshot_file for this snap is: volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcea046-404c-4356-b789-66951828850b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:48 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:48 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:49 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:49 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:49 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.551s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a4e75-777e-4c77-b255-30a407dd10e0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:49 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:49 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Flow 'volume_create_manager' (e591fb62-bc6f-4d17-8759-bbc4a6a781ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57db9b7-5219-4b67-ad0e-14cf52741e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57db9b7-5219-4b67-ad0e-14cf52741e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1641988500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5616419-5492-45e8-be49-03fa1bb335ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b0fb55d3245e199843c5fddbd95a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:49Z,use_quota=True,user_id='3c6b41434afc498f9e4598e995e8610f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c8a176-4a3e-483e-b2f5-b06abd429644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c8a176-4a3e-483e-b2f5-b06abd429644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1438a3bf-5abe-4b70-8789-07fd2442a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1438a3bf-5abe-4b70-8789-07fd2442a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5616419-5492-45e8-be49-03fa1bb335ac', 'volume_name': 'volume-b5616419-5492-45e8-be49-03fa1bb335ac', 'volume_size': 2}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb71268-0cf5-49c0-9e6b-80e9e3a894c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb71268-0cf5-49c0-9e6b-80e9e3a894c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687fa49e-1073-4a7f-82da-7dc459434633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:49 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Volume b5616419-5492-45e8-be49-03fa1bb335ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5616419-5492-45e8-be49-03fa1bb335ac', 'volume_size': 2} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1641988500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5616419-5492-45e8-be49-03fa1bb335ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b0fb55d3245e199843c5fddbd95a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:49Z,use_quota=True,user_id='3c6b41434afc498f9e4598e995e8610f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Creating volume b5616419-5492-45e8-be49-03fa1bb335ac {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:49 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac 2147483648 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:49 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac 2147483648 Apr 24 15:38:49 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:49 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:49 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:49 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:49 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:50 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac 2147483648" returned: 0 in 0.625s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:50 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac Apr 24 15:38:50 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:50 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.571s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:50 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9 Apr 24 15:38:50 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:50 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687fa49e-1073-4a7f-82da-7dc459434633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5616419-5492-45e8-be49-03fa1bb335ac', 'volume_size': 2}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed660095-7f22-4207-9219-087c72dce656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:50 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Volume volume-b5616419-5492-45e8-be49-03fa1bb335ac (b5616419-5492-45e8-be49-03fa1bb335ac): created successfully Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed660095-7f22-4207-9219-087c72dce656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Flow 'volume_create_manager' (e591fb62-bc6f-4d17-8759-bbc4a6a781ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b514a4ac-2df1-402b-9343-d98209208691 tempest-VolumesCloneNegativeTest-366323638 None] Created volume successfully. Apr 24 15:38:50 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98.d93f4901-9309-45c8-9d60-87e33ee1a6f9" returned: 0 in 0.433s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d93f4901-9309-45c8-9d60-87e33ee1a6f9" released by "_delete_snapshot" :: held 2.199s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" released by "delete_snapshot" :: held 2.222s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Created reservations ['2d0cd580-d309-4baf-94e8-c485e26ad31e', 'b27d78d9-a509-41b0-aebd-2867e84df6e4', '27ca00eb-a8eb-4344-b2ca-f563a8d77b40', '8919b75c-e59d-4465-a815-fa7eceec4bad'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Delete snapshot completed successfully. Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-31172578-1b7b-4053-bc7f-5b553c32dc5a tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-d93f4901-9309-45c8-9d60-87e33ee1a6f9-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Acquiring lock "cinder-b5616419-5492-45e8-be49-03fa1bb335ac-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "cinder-b5616419-5492-45e8-be49-03fa1bb335ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Acquiring lock "cinder-quobyte-b5616419-5492-45e8-be49-03fa1bb335ac" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "cinder-quobyte-b5616419-5492-45e8-be49-03fa1bb335ac" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[171031cb-ef6f-4bb7-baf2-e624b381d9d4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-d109e89f-9c34-48d3-96aa-a9f846e7eb98-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-d109e89f-9c34-48d3-96aa-a9f846e7eb98-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:51 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac Apr 24 15:38:51 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:38:51 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c74fe3-2698-4983-b568-242d92de1d3b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:52 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:52 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:52 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:52 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac Apr 24 15:38:52 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:52 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:52 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98 Apr 24 15:38:52 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:52 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-b5616419-5492-45e8-be49-03fa1bb335ac" returned: 0 in 0.432s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "cinder-quobyte-b5616419-5492-45e8-be49-03fa1bb335ac" released by "delete_volume" :: held 0.980s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Created reservations ['7318328b-a5af-41b9-84d4-dc3f2645a3b0', 'fad54a24-599c-4b9a-95ec-18a5bfe8f96d', '37e25558-60e9-4d15-b271-ac8f40c1ea3a', '8d228648-f2a8-4817-ac92-a008434a59f1'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:52 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:52 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:53 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d109e89f-9c34-48d3-96aa-a9f846e7eb98" returned: 0 in 0.460s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-d109e89f-9c34-48d3-96aa-a9f846e7eb98" released by "delete_volume" :: held 1.058s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Created reservations ['5c9f0b58-8c24-4b8c-afde-9a1db4aea841', '9bff9791-c122-4f76-85c7-db0f673458a8', '382f8e5a-ad41-4493-a76a-0799e9deb899', 'f6b13578-3fdb-4b2e-903e-3173cd032443'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:53 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:38:53 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:53 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.463s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Deleted volume successfully. Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a1e85036-67b3-4c00-82a4-a127572017b0 tempest-VolumesCloneNegativeTest-366323638 None] Lock "cinder-b5616419-5492-45e8-be49-03fa1bb335ac-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:53 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.421s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:38:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Deleted volume successfully. Apr 24 15:38:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-8f059771-f393-4972-b149-9598b450e88c tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-d109e89f-9c34-48d3-96aa-a9f846e7eb98-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (b07efc9c-9f2f-4150-b4ef-2ad001a01535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0bd6e5-cbbb-4e73-99bd-f9836fefd6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0bd6e5-cbbb-4e73-99bd-f9836fefd6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-460364083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7ee89-81c4-4a76-8780-7a7c3e1ad443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:54Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7915555-d7d5-410d-8050-454cb528c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7915555-d7d5-410d-8050-454cb528c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5413b1ab-e5e6-4636-8202-2e465050328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5413b1ab-e5e6-4636-8202-2e465050328c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'volume_name': 'volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423824dc-6565-46e8-8cc4-129660f3e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423824dc-6565-46e8-8cc4-129660f3e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eef6bb7-7958-45d9-91e4-0d3c432a4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:54 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Volume 36b7ee89-81c4-4a76-8780-7a7c3e1ad443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'volume_size': 1} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-460364083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7ee89-81c4-4a76-8780-7a7c3e1ad443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:54Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Creating volume 36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:54 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:54 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 1073741824 Apr 24 15:38:54 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:55 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 1073741824" returned: 0 in 0.682s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:55 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:38:55 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:55 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eef6bb7-7958-45d9-91e4-0d3c432a4c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c99f5d9-5e8c-41cd-b201-b2ce4bf291f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:55 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Volume volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 (36b7ee89-81c4-4a76-8780-7a7c3e1ad443): created successfully Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c99f5d9-5e8c-41cd-b201-b2ce4bf291f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (b07efc9c-9f2f-4150-b4ef-2ad001a01535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:55 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a815fe91-91bc-4463-99ed-dab5cd6867d7 tempest-VolumeDependencyTests-2104325514 None] Created volume successfully. Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (7595d121-a8b2-4dde-b84b-c1a5ea67bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad64268e-b09b-4391-a270-0405e4584ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad64268e-b09b-4391-a270-0405e4584ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1692989421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7369f240-2c0b-4d91-8253-96b20cc3b86d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:56Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0302cd51-c0e7-4ca5-aa5a-c620dd5367b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0302cd51-c0e7-4ca5-aa5a-c620dd5367b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40ee24-ea7e-4823-a3fd-8de92321bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40ee24-ea7e-4823-a3fd-8de92321bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7369f240-2c0b-4d91-8253-96b20cc3b86d', 'volume_name': 'volume-7369f240-2c0b-4d91-8253-96b20cc3b86d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b73c9ef-c62b-4906-aa05-c4c0e2e7fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b73c9ef-c62b-4906-aa05-c4c0e2e7fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004aad27-d14b-4fd1-ba70-4e159050d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:56 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Volume 7369f240-2c0b-4d91-8253-96b20cc3b86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7369f240-2c0b-4d91-8253-96b20cc3b86d', 'volume_size': 1} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1692989421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7369f240-2c0b-4d91-8253-96b20cc3b86d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:56Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Creating volume 7369f240-2c0b-4d91-8253-96b20cc3b86d {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:38:56 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:56 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d 1073741824 Apr 24 15:38:56 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:56 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (424edec1-0753-4972-a1cc-9236890d46b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37061054-3760-4885-bb14-25422ba5f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37061054-3760-4885-bb14-25422ba5f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1726604123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f53f0fe-da93-49e3-b215-ff9cf1042916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7f0f5f791545dfa47d8c28307d36c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=36b7ee89-81c4-4a76-8780-7a7c3e1ad443,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:57Z,use_quota=True,user_id='088b3bcc07134743a0bfd3d2e329f64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55075ddd-aded-4f57-b977-d2ac10b2f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55075ddd-aded-4f57-b977-d2ac10b2f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c3b587-9235-481b-8ec0-a2045af8e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c3b587-9235-481b-8ec0-a2045af8e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7f53f0fe-da93-49e3-b215-ff9cf1042916', 'volume_name': 'volume-7f53f0fe-da93-49e3-b215-ff9cf1042916', 'volume_size': 1, 'source_volid': '36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9716c9d7-41b7-41c8-b8ff-eec033b66c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9716c9d7-41b7-41c8-b8ff-eec033b66c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0c518a-b752-4835-bd0d-ac4aa16ac0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Volume 7f53f0fe-da93-49e3-b215-ff9cf1042916: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7f53f0fe-da93-49e3-b215-ff9cf1042916', 'volume_size': 1, 'source_volid': '36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'source_volstatus': 'available'} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:57 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d 1073741824" returned: 0 in 0.639s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:57 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d Apr 24 15:38:57 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:57 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d" returned: 0 in 0.437s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.537s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:38:57 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Cloning volume 36b7ee89-81c4-4a76-8780-7a7c3e1ad443 to volume 7f53f0fe-da93-49e3-b215-ff9cf1042916 Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004aad27-d14b-4fd1-ba70-4e159050d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7369f240-2c0b-4d91-8253-96b20cc3b86d', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecabb6e1-52a5-4ff1-8b5a-571afd4610a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Creating offline snapshot 4c4be7b6-f510-4f69-9ed9-1648d25b46cb of volume 36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:38:57 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Volume volume-7369f240-2c0b-4d91-8253-96b20cc3b86d (7369f240-2c0b-4d91-8253-96b20cc3b86d): created successfully Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecabb6e1-52a5-4ff1-8b5a-571afd4610a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (7595d121-a8b2-4dde-b84b-c1a5ea67bf44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e5dde-1be7-4bcd-99b2-1ab572d924fc]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:38:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d57f4fdc-46f4-4a68-9c94-b0d2feb3c6de tempest-VolumesListTestJSON-1720529707 None] Created volume successfully. Apr 24 15:38:57 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:38:57 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:58 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.525s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:58 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb 1G Apr 24 15:38:58 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:58 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb 1G" returned: 0 in 0.627s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:58 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:38:58 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (7f74d994-fc4e-4518-aa74-bbb393163daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a88447-d514-4874-a70b-9675fc35b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:58 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a88447-d514-4874-a70b-9675fc35b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-866522484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e53f81-de35-456d-8276-54ae9111acab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:59Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52db4ae4-bc7a-46c0-bbf2-c6821c53c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52db4ae4-bc7a-46c0-bbf2-c6821c53c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed7f74-13b2-4c6d-ab8e-2740e95d175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed7f74-13b2-4c6d-ab8e-2740e95d175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e53f81-de35-456d-8276-54ae9111acab', 'volume_name': 'volume-d6e53f81-de35-456d-8276-54ae9111acab', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073f755d-7468-4ee3-9ed8-2f440fe09e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073f755d-7468-4ee3-9ed8-2f440fe09e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b1432-ddc0-4012-baec-3cc15c4e1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:38:59 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Volume d6e53f81-de35-456d-8276-54ae9111acab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e53f81-de35-456d-8276-54ae9111acab', 'volume_size': 1} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:38:59 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.498s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:59 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb is being set with open permissions: ugo+rw Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:59 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:38:59 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:38:59 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.429s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:38:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:38:59 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info Apr 24 15:38:59 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:00 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info" returned: 0 in 0.436s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:00 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info is being set with open permissions: ugo+rw Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:00 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info Apr 24 15:39:00 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:00 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.info" returned: 0 in 0.423s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] snapshot: 4c4be7b6-f510-4f69-9ed9-1648d25b46cb, volume: 7f53f0fe-da93-49e3-b215-ff9cf1042916, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e572d1-4988-4f12-8a2a-7596d673cc1a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:00 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:39:00 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:01 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.504s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c7068-027f-4bf7-a73a-7829814ccea6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:01 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:39:01 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:01 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.511s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:39:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:01 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 Apr 24 15:39:01 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:06 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916" returned: 0 in 4.368s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541ac69-29b3-42ac-989f-d7c86cc7a78a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:06 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:39:06 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:06 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.653s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:39:06 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Converted 1024.00 MB image at 234.31 MB/s Apr 24 15:39:06 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 is being set with open permissions: ugo+rw Apr 24 15:39:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:06 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 Apr 24 15:39:06 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:07 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916" returned: 0 in 0.438s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" released by "_copy_volume_from_snapshot" :: held 6.553s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-4c4be7b6-f510-4f69-9ed9-1648d25b46cb" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-4c4be7b6-f510-4f69-9ed9-1648d25b46cb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Deleting offline snapshot 4c4be7b6-f510-4f69-9ed9-1648d25b46cb of volume 36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] snapshot_file for this snap is: volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fec87f-6dd1-4977-a17f-3b60343722b0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:07 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:39:07 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:07 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.535s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3696caa-2b7c-4e3a-ad45-c070825f1b44]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:07 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:39:07 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:08 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.494s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:08 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:39:08 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:08 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.521s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:08 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb Apr 24 15:39:08 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:09 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443.4c4be7b6-f510-4f69-9ed9-1648d25b46cb" returned: 0 in 0.419s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-4c4be7b6-f510-4f69-9ed9-1648d25b46cb" released by "_delete_snapshot" :: held 2.081s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.774s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.388s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-866522484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e53f81-de35-456d-8276-54ae9111acab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:38:59Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Creating volume d6e53f81-de35-456d-8276-54ae9111acab {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:39:09 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:09 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab 1073741824 Apr 24 15:39:09 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0c518a-b752-4835-bd0d-ac4aa16ac0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f53f0fe-da93-49e3-b215-ff9cf1042916', 'volume_size': 1, 'source_volid': '36b7ee89-81c4-4a76-8780-7a7c3e1ad443', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8c02bf-21df-4b90-bef5-0d93fc79edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Volume volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 (7f53f0fe-da93-49e3-b215-ff9cf1042916): created successfully Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8c02bf-21df-4b90-bef5-0d93fc79edc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Flow 'volume_create_manager' (424edec1-0753-4972-a1cc-9236890d46b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e2b18f01-801a-4514-acc5-2a6de7d399d6 tempest-VolumeDependencyTests-2104325514 None] Created volume successfully. Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-36b7ee89-81c4-4a76-8780-7a7c3e1ad443-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-36b7ee89-81c4-4a76-8780-7a7c3e1ad443-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[963d0d0f-0b3c-46f8-bb7b-648013a2bb2a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:09 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:39:09 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:10 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab 1073741824" returned: 0 in 0.650s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:10 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab Apr 24 15:39:10 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:10 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.546s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:10 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443 Apr 24 15:39:10 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:10 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab" returned: 0 in 0.432s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b1432-ddc0-4012-baec-3cc15c4e1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e53f81-de35-456d-8276-54ae9111acab', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daef564f-2abc-4b82-96ba-64b6deae9298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:10 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Volume volume-d6e53f81-de35-456d-8276-54ae9111acab (d6e53f81-de35-456d-8276-54ae9111acab): created successfully Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daef564f-2abc-4b82-96ba-64b6deae9298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (7f74d994-fc4e-4518-aa74-bbb393163daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:10 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d11a6185-b6d9-4ab6-92af-3c23d028c1b1 tempest-VolumesListTestJSON-1720529707 None] Created volume successfully. Apr 24 15:39:10 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" returned: 0 in 0.479s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-36b7ee89-81c4-4a76-8780-7a7c3e1ad443" released by "delete_volume" :: held 1.085s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Created reservations ['31e3eca1-5f2b-4a34-9748-a2e8236799e4', '97003db1-322f-432f-a9f4-d8871ad17bb8', 'e63f32f7-a2e0-4b6c-9cab-54341c21d2b8', 'cfd0916b-6f04-49fb-a36f-e3d8e8422297'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:11 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:11 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (8ff4f33e-d4e0-418e-b113-f1a77bccde47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b40857e-c246-4d37-8754-abe22d130197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b40857e-c246-4d37-8754-abe22d130197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2049592433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17370290-6d8b-4c44-b6ad-bf1fc57337ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:39:11Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9164acd9-3795-45a0-bacf-459f8ba25a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9164acd9-3795-45a0-bacf-459f8ba25a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c6365-fbb1-4250-8b99-87046ec0c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c6365-fbb1-4250-8b99-87046ec0c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17370290-6d8b-4c44-b6ad-bf1fc57337ca', 'volume_name': 'volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c0ace8-d72b-460d-9cd5-16a7a1fd8964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c0ace8-d72b-460d-9cd5-16a7a1fd8964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6260dce-b37d-44a0-9463-a7d35235481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:11 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Volume 17370290-6d8b-4c44-b6ad-bf1fc57337ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca', 'volume_size': 1} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2049592433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17370290-6d8b-4c44-b6ad-bf1fc57337ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193b71e5cef147f5a7f86d70893fc54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:39:11Z,use_quota=True,user_id='c281d480557540608b3257570556469e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Creating volume 17370290-6d8b-4c44-b6ad-bf1fc57337ca {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:39:11 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:11 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca 1073741824 Apr 24 15:39:11 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:11 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.454s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Deleted volume successfully. Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-36c1bcc3-b51f-4cee-975b-6be1af17557b tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-36b7ee89-81c4-4a76-8780-7a7c3e1ad443-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:11 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca 1073741824" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:11 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca Apr 24 15:39:11 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-7f53f0fe-da93-49e3-b215-ff9cf1042916-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-7f53f0fe-da93-49e3-b215-ff9cf1042916-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2830844e-67a7-4c2e-ab12-c83024cda89a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:12 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 Apr 24 15:39:12 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:12 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca" returned: 0 in 0.483s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6260dce-b37d-44a0-9463-a7d35235481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764e0b52-b32b-48bd-bae5-4959ec09e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:12 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Volume volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca (17370290-6d8b-4c44-b6ad-bf1fc57337ca): created successfully Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764e0b52-b32b-48bd-bae5-4959ec09e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Flow 'volume_create_manager' (8ff4f33e-d4e0-418e-b113-f1a77bccde47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:12 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e65ce2e8-3b08-49ab-8e65-0ddd07c609a8 tempest-VolumesListTestJSON-1720529707 None] Created volume successfully. Apr 24 15:39:12 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:12 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916 Apr 24 15:39:12 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:13 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7f53f0fe-da93-49e3-b215-ff9cf1042916" returned: 0 in 0.417s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-7f53f0fe-da93-49e3-b215-ff9cf1042916" released by "delete_volume" :: held 0.983s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Created reservations ['0248b525-8769-4b9b-b553-91929e543fa7', '666513a6-1ba4-4857-8f80-e20369514864', '52c039a9-8b79-47d9-a88e-08e5b277e11b', 'a7c88d26-299f-437f-b8a1-bfc5942fcd3b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:13 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:13 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:13 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.452s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:13 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Deleted volume successfully. Apr 24 15:39:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a27bc207-859b-42e2-8d1b-ea055c69632e tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-7f53f0fe-da93-49e3-b215-ff9cf1042916-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-0e92a13e-68b4-4779-bcbf-a92deb6b924a-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-0e92a13e-68b4-4779-bcbf-a92deb6b924a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c6ace-a9b2-450e-86e8-d4f370fe01e0]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:14 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a Apr 24 15:39:14 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:15 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a" returned: 0 in 0.561s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:15 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a Apr 24 15:39:15 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:15 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0e92a13e-68b4-4779-bcbf-a92deb6b924a" returned: 0 in 0.440s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-quobyte-0e92a13e-68b4-4779-bcbf-a92deb6b924a" released by "delete_volume" :: held 1.061s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Created reservations ['7f5ebe93-d1af-4d6e-a323-8f3741350ef9', 'babd5e43-07c3-4d0b-b91a-1d1bbe029198', '27679548-75d9-4f71-8255-54a48fbd106d', '2d54e092-e063-4940-ba0f-5ccb36d1ddd0'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-17370290-6d8b-4c44-b6ad-bf1fc57337ca-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:15 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-17370290-6d8b-4c44-b6ad-bf1fc57337ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:15 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-quobyte-17370290-6d8b-4c44-b6ad-bf1fc57337ca" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-17370290-6d8b-4c44-b6ad-bf1fc57337ca" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55802b0-791c-40ea-b28a-757124ccc8ad]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:15 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca Apr 24 15:39:15 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:16 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.476s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Deleted volume successfully. Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20a0e639-26cb-4847-8602-dea9e40690dd tempest-VolumeDependencyTests-2104325514 None] Lock "cinder-0e92a13e-68b4-4779-bcbf-a92deb6b924a-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:16 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:16 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca Apr 24 15:39:16 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:16 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-17370290-6d8b-4c44-b6ad-bf1fc57337ca" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-17370290-6d8b-4c44-b6ad-bf1fc57337ca" released by "delete_volume" :: held 1.028s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Created reservations ['88bff98f-8e15-4d7d-8fdf-f3f6643aaec3', '45b66d07-7866-4fb2-9082-3b6abb495212', '957498f4-66ea-4f75-8edb-f39aa988fc9b', '981f543d-7f92-4829-adba-56c38ff03fa0'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:16 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:16 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:17 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.496s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:17 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:17 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Deleted volume successfully. Apr 24 15:39:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-daa8577f-2e99-48c4-95f9-6ec2ddfb4425 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-17370290-6d8b-4c44-b6ad-bf1fc57337ca-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-d6e53f81-de35-456d-8276-54ae9111acab-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-d6e53f81-de35-456d-8276-54ae9111acab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-quobyte-d6e53f81-de35-456d-8276-54ae9111acab" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-d6e53f81-de35-456d-8276-54ae9111acab" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d0e4c-23b7-4f45-a09f-2da905e0301e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:18 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab Apr 24 15:39:18 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:18 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab" returned: 0 in 0.524s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:18 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab Apr 24 15:39:18 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:19 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d6e53f81-de35-456d-8276-54ae9111acab" returned: 0 in 0.458s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-d6e53f81-de35-456d-8276-54ae9111acab" released by "delete_volume" :: held 1.034s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Created reservations ['19e854af-664a-4405-861f-c39beadc169a', 'a707246b-e6fe-4e70-aa0d-96de6ccb784f', 'ebec7285-fb0d-4504-a86e-7faeb9b5a92b', 'e107855c-2009-4fe4-a558-0b03b8fe7489'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:19 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:19 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:19 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.430s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Deleted volume successfully. Apr 24 15:39:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b4c1b799-afe6-4fec-8c31-a3f1019d4918 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-d6e53f81-de35-456d-8276-54ae9111acab-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-7369f240-2c0b-4d91-8253-96b20cc3b86d-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-7369f240-2c0b-4d91-8253-96b20cc3b86d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "cinder-quobyte-7369f240-2c0b-4d91-8253-96b20cc3b86d" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-7369f240-2c0b-4d91-8253-96b20cc3b86d" acquired by "delete_volume" :: waited 0.013s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3dbc0-1c57-4a56-8d5a-1661f340e1a4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:20 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d Apr 24 15:39:20 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:20 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d" returned: 0 in 0.512s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:20 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d Apr 24 15:39:20 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:21 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-7369f240-2c0b-4d91-8253-96b20cc3b86d" returned: 0 in 0.419s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-quobyte-7369f240-2c0b-4d91-8253-96b20cc3b86d" released by "delete_volume" :: held 0.970s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Created reservations ['3af1fb45-297b-4129-b137-9b1820471c36', '727043a7-1347-4022-baa0-71eb3cfd6f76', '8be2a13a-642c-43dd-a4a5-1577d99a9847', '7d4980b7-0dce-48a8-915f-cd23d71bf84b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:21 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:21 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:21 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.418s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:21 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Deleted volume successfully. Apr 24 15:39:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab985ff6-22d0-4abb-af6d-d8225a2c20b0 tempest-VolumesListTestJSON-1720529707 None] Lock "cinder-7369f240-2c0b-4d91-8253-96b20cc3b86d-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Flow 'volume_create_manager' (f1bc77d6-a736-4666-b60e-5e8ae627b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad04ff97-2266-4d6f-bc9e-feb9862497e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad04ff97-2266-4d6f-bc9e-feb9862497e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-477733142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5333a3-daa2-431a-817e-62bbcf8a2473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981d3820e3f471988af5e48c95d63d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:39:25Z,use_quota=True,user_id='0ff3e864c2104a91affaf4ed8cfb6ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df02722e-3f25-482a-8af4-d53553a58c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df02722e-3f25-482a-8af4-d53553a58c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae2e584-08c3-4b6e-9d2c-2f79e91edf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae2e584-08c3-4b6e-9d2c-2f79e91edf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5333a3-daa2-431a-817e-62bbcf8a2473', 'volume_name': 'volume-4a5333a3-daa2-431a-817e-62bbcf8a2473', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff8945-78ed-4be3-972e-c1b32855530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff8945-78ed-4be3-972e-c1b32855530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e56dd-cacf-49ae-b3f0-4cf79be5604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Volume 4a5333a3-daa2-431a-817e-62bbcf8a2473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5333a3-daa2-431a-817e-62bbcf8a2473', 'volume_size': 1} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-477733142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5333a3-daa2-431a-817e-62bbcf8a2473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981d3820e3f471988af5e48c95d63d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:39:25Z,use_quota=True,user_id='0ff3e864c2104a91affaf4ed8cfb6ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Creating volume 4a5333a3-daa2-431a-817e-62bbcf8a2473 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:39:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:39:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:25 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 1073741824 Apr 24 15:39:25 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:25 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 1073741824" returned: 0 in 0.594s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:25 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 Apr 24 15:39:25 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:26 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473" returned: 0 in 0.437s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e56dd-cacf-49ae-b3f0-4cf79be5604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5333a3-daa2-431a-817e-62bbcf8a2473', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23238d08-9b20-4109-ba3d-beef6bc0e55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:39:26 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Volume volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 (4a5333a3-daa2-431a-817e-62bbcf8a2473): created successfully Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23238d08-9b20-4109-ba3d-beef6bc0e55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:39:26 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Flow 'volume_create_manager' (f1bc77d6-a736-4666-b60e-5e8ae627b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:39:26 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-01e6cc03-c382-4b73-9b79-d007d0025a9e tempest-VolumesNegativeTest-1954167707 None] Created volume successfully. Apr 24 15:39:36 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=80,cinder:UPDATE=100,cinder:INSERT=22,cinder:DELETE=8 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:39:36 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=70,cinder:UPDATE=124,cinder:INSERT=32,cinder:DELETE=11 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:49 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:49 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:49 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.426s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Acquiring lock "cinder-4a5333a3-daa2-431a-817e-62bbcf8a2473-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "cinder-4a5333a3-daa2-431a-817e-62bbcf8a2473-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Acquiring lock "cinder-quobyte-4a5333a3-daa2-431a-817e-62bbcf8a2473" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "cinder-quobyte-4a5333a3-daa2-431a-817e-62bbcf8a2473" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d5e79-0db2-4048-a3c7-15da324744ae]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:39:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:58 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 Apr 24 15:39:58 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:59 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473" returned: 0 in 0.499s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:59 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473 Apr 24 15:39:59 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:39:59 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4a5333a3-daa2-431a-817e-62bbcf8a2473" returned: 0 in 0.416s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "cinder-quobyte-4a5333a3-daa2-431a-817e-62bbcf8a2473" released by "delete_volume" :: held 0.955s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Created reservations ['163bed99-a1c8-48fa-b781-073c80438058', 'cb79f905-bac4-4cfc-a4da-04a0602d8ccc', '90ded9ad-952b-4507-a94d-febde53c4f50', 'ab4b8239-905f-4734-b09d-d7e2d33d535f'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:39:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:39:59 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:39:59 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:00 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.424s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:00 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Deleted volume successfully. Apr 24 15:40:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c6e25411-ab7e-4de1-a524-b6ae97227115 tempest-VolumesNegativeTest-1954167707 None] Lock "cinder-4a5333a3-daa2-431a-817e-62bbcf8a2473-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (09110526-ee05-41ad-ac78-eb9270c4c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2e875f-a086-4ec1-98a0-533cb1819b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2e875f-a086-4ec1-98a0-533cb1819b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611024978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9838ae-7ac8-4247-b03d-fec6860194b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:03Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b17ba40-bf79-4492-84e0-776d32a0709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b17ba40-bf79-4492-84e0-776d32a0709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56936c6-a5de-4900-bbd9-46e0ea303dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56936c6-a5de-4900-bbd9-46e0ea303dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9838ae-7ac8-4247-b03d-fec6860194b9', 'volume_name': 'volume-4e9838ae-7ac8-4247-b03d-fec6860194b9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c92a06-af44-4f1f-8c27-34287b08df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c92a06-af44-4f1f-8c27-34287b08df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a67820-b54e-4ff6-be3f-19c6b6180152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Volume 4e9838ae-7ac8-4247-b03d-fec6860194b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9838ae-7ac8-4247-b03d-fec6860194b9', 'volume_size': 1} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611024978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9838ae-7ac8-4247-b03d-fec6860194b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:03Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Creating volume 4e9838ae-7ac8-4247-b03d-fec6860194b9 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:03 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:03 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 1073741824 Apr 24 15:40:03 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (6e316528-1c2f-4733-b750-0ef15adf001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f456684-75fd-48ab-a3f5-0867fd0c1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f456684-75fd-48ab-a3f5-0867fd0c1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937788695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef179b1b-2889-4242-9df4-84b663b58316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:03Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc39670-8661-4ce1-97ff-b8c37e39e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc39670-8661-4ce1-97ff-b8c37e39e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2600be0-c0b2-45da-8d1e-243519247787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2600be0-c0b2-45da-8d1e-243519247787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef179b1b-2889-4242-9df4-84b663b58316', 'volume_name': 'volume-ef179b1b-2889-4242-9df4-84b663b58316', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805633d8-43b1-4d85-bdc6-a451dd5fc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805633d8-43b1-4d85-bdc6-a451dd5fc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4b6ce-3309-4a67-b616-bd7e06ef0ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Volume ef179b1b-2889-4242-9df4-84b663b58316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef179b1b-2889-4242-9df4-84b663b58316', 'volume_size': 1} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (3d3532a2-ba31-4814-859e-b5c560097615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0519e29b-8331-410d-8c39-22698547f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0519e29b-8331-410d-8c39-22698547f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325694832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb67f0-efb9-49ca-a8b9-8c0c4d890037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca99b6b-8110-418c-a80d-d62a068ef3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca99b6b-8110-418c-a80d-d62a068ef3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6106bfb-5149-4ad1-b8c9-8baf3b1f485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6106bfb-5149-4ad1-b8c9-8baf3b1f485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcb67f0-efb9-49ca-a8b9-8c0c4d890037', 'volume_name': 'volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1f343c-d073-47ef-8615-929458c7ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1f343c-d073-47ef-8615-929458c7ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed82d1da-8afe-44e5-b9a1-8aa49dd56a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Volume 6bcb67f0-efb9-49ca-a8b9-8c0c4d890037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037', 'volume_size': 1} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:03 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 1073741824" returned: 0 in 0.787s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:03 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 Apr 24 15:40:03 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (f44b14f5-091e-42b6-9785-bc098b5a9793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682dec9-6430-4656-9fb7-756d4109493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682dec9-6430-4656-9fb7-756d4109493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1682005575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9056fc1-bc7c-4cb5-869b-e917a6264c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2681f201-f9bc-49d4-9460-36bf5465fb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:03 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2681f201-f9bc-49d4-9460-36bf5465fb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ac1cf-aed5-4269-939f-8eabb9c3162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ac1cf-aed5-4269-939f-8eabb9c3162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9056fc1-bc7c-4cb5-869b-e917a6264c95', 'volume_name': 'volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a800c3a9-dd2f-4dda-92cb-e09f7c704ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a800c3a9-dd2f-4dda-92cb-e09f7c704ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b04b97-916d-41b1-b4e4-2dfdd2340d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume a9056fc1-bc7c-4cb5-869b-e917a6264c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95', 'volume_size': 1} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (60093cfc-7ce1-4dbd-9f94-53b865f7a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acde768-e5bd-416b-8a76-9d753047de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acde768-e5bd-416b-8a76-9d753047de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355096318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ab726-9017-40ef-87ad-15659127782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b71807-eab6-480c-8a8d-f90670928103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b71807-eab6-480c-8a8d-f90670928103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20544a40-5d07-4237-8157-a945043f217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20544a40-5d07-4237-8157-a945043f217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1ab726-9017-40ef-87ad-15659127782e', 'volume_name': 'volume-0c1ab726-9017-40ef-87ad-15659127782e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f800c1db-e241-467b-844d-bc831ddafd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f800c1db-e241-467b-844d-bc831ddafd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692ccf04-451b-45bf-b9b1-cfcd1fd3ab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume 0c1ab726-9017-40ef-87ad-15659127782e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1ab726-9017-40ef-87ad-15659127782e', 'volume_size': 1} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:04 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937788695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef179b1b-2889-4242-9df4-84b663b58316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:03Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Creating volume ef179b1b-2889-4242-9df4-84b663b58316 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:04 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a67820-b54e-4ff6-be3f-19c6b6180152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9838ae-7ac8-4247-b03d-fec6860194b9', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 1073741824 Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f5d5c-645e-494d-9fc2-413254ede300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:04 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:04 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Volume volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 (4e9838ae-7ac8-4247-b03d-fec6860194b9): created successfully Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f5d5c-645e-494d-9fc2-413254ede300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:04 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (09110526-ee05-41ad-ac78-eb9270c4c192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:04 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-4429d8ec-e49a-412b-a62b-ff80a7541bd2 tempest-CreateVolumesFromImageTest-1702315108 None] Created volume successfully. Apr 24 15:40:05 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 1073741824" returned: 0 in 0.602s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:05 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 Apr 24 15:40:05 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:05 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316" returned: 0 in 0.472s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325694832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb67f0-efb9-49ca-a8b9-8c0c4d890037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Creating volume 6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:05 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:05 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 1073741824 Apr 24 15:40:05 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4b6ce-3309-4a67-b616-bd7e06ef0ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef179b1b-2889-4242-9df4-84b663b58316', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b6529a-00bc-4e3c-8c02-67d03ddce044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:05 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Volume volume-ef179b1b-2889-4242-9df4-84b663b58316 (ef179b1b-2889-4242-9df4-84b663b58316): created successfully Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b6529a-00bc-4e3c-8c02-67d03ddce044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:05 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (6e316528-1c2f-4733-b750-0ef15adf001e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:05 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3ddc9ea1-54ac-432a-9993-209326b028ea tempest-CreateVolumesFromImageTest-1702315108 None] Created volume successfully. Apr 24 15:40:06 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 1073741824" returned: 0 in 0.632s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:06 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 Apr 24 15:40:06 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:06 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" returned: 0 in 0.475s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.648s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1682005575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9056fc1-bc7c-4cb5-869b-e917a6264c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Creating volume a9056fc1-bc7c-4cb5-869b-e917a6264c95 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:06 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:06 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 1073741824 Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed82d1da-8afe-44e5-b9a1-8aa49dd56a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:06 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e34981-a95c-417f-a4c2-46dd6ef30e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:06 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Volume volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 (6bcb67f0-efb9-49ca-a8b9-8c0c4d890037): created successfully Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e34981-a95c-417f-a4c2-46dd6ef30e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (3d3532a2-ba31-4814-859e-b5c560097615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e9a5462c-01ce-4c8b-9732-c1bcd8cce7b9 tempest-CreateVolumesFromImageTest-1702315108 None] Created volume successfully. Apr 24 15:40:07 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 1073741824" returned: 0 in 0.659s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:07 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 Apr 24 15:40:07 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:07 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95" returned: 0 in 0.466s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.538s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355096318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ab726-9017-40ef-87ad-15659127782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886b5ad6f9f4eb8b5f70ba358a127af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:04Z,use_quota=True,user_id='b99527ead7714a8d83d24e42faafe1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Creating volume 0c1ab726-9017-40ef-87ad-15659127782e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:07 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:07 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e 1073741824 Apr 24 15:40:07 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b04b97-916d-41b1-b4e4-2dfdd2340d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a08e6e-3a36-4c42-83bb-8988e766e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:07 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 (a9056fc1-bc7c-4cb5-869b-e917a6264c95): created successfully Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a08e6e-3a36-4c42-83bb-8988e766e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (f44b14f5-091e-42b6-9785-bc098b5a9793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-44389325-8939-449c-8318-1e7aa4283c4c tempest-CreateVolumesFromImageTest-1702315108 None] Created volume successfully. Apr 24 15:40:08 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e 1073741824" returned: 0 in 0.683s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:08 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e Apr 24 15:40:08 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:09 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e" returned: 0 in 0.462s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692ccf04-451b-45bf-b9b1-cfcd1fd3ab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1ab726-9017-40ef-87ad-15659127782e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba9b37a-0064-4800-b396-607b57d20e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Volume volume-0c1ab726-9017-40ef-87ad-15659127782e (0c1ab726-9017-40ef-87ad-15659127782e): created successfully Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba9b37a-0064-4800-b396-607b57d20e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Flow 'volume_create_manager' (60093cfc-7ce1-4dbd-9f94-53b865f7a16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:09 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b079ac34-bdd0-4b56-9e08-54abd5f30b4c tempest-CreateVolumesFromImageTest-1702315108 None] Created volume successfully. Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-0c1ab726-9017-40ef-87ad-15659127782e-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-0c1ab726-9017-40ef-87ad-15659127782e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-quobyte-0c1ab726-9017-40ef-87ad-15659127782e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-0c1ab726-9017-40ef-87ad-15659127782e" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b309c00-e097-43de-b24a-09d921921f02]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:09 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e Apr 24 15:40:10 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:10 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e" returned: 0 in 0.539s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:10 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e Apr 24 15:40:10 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:10 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-0c1ab726-9017-40ef-87ad-15659127782e" returned: 0 in 0.446s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:10 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-0c1ab726-9017-40ef-87ad-15659127782e" released by "delete_volume" :: held 1.031s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:10 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Created reservations ['658ebfc5-77e9-4cfe-95f5-dbd3fe03f9fc', '2f8c44b3-d2cf-4d15-9b26-c028d2056cfe', '82304c0e-2271-46b7-90f5-97c089cb166b', '5cf3addb-aaea-49da-b2a7-a7e7640798be'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:11 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:11 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:11 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:11 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Deleted volume successfully. Apr 24 15:40:11 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-060d0086-6714-46f2-8b2a-4c2c75a0ca3d tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-0c1ab726-9017-40ef-87ad-15659127782e-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-a9056fc1-bc7c-4cb5-869b-e917a6264c95-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-a9056fc1-bc7c-4cb5-869b-e917a6264c95-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-quobyte-a9056fc1-bc7c-4cb5-869b-e917a6264c95" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-a9056fc1-bc7c-4cb5-869b-e917a6264c95" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6054252-5b62-483f-8ee2-44b4f72f49a4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:12 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 Apr 24 15:40:12 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:12 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95" returned: 0 in 0.573s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:12 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:12 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95 Apr 24 15:40:12 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:13 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a9056fc1-bc7c-4cb5-869b-e917a6264c95" returned: 0 in 0.468s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-a9056fc1-bc7c-4cb5-869b-e917a6264c95" released by "delete_volume" :: held 1.081s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Created reservations ['ffa115ed-f0e6-4f0c-9d77-3e411d963413', '828cba09-4177-4a1b-9eb5-5fcdee8e4257', '0209844d-f8ce-4dbc-a637-cc3093005f5f', '3b219b87-d973-45ac-8df1-5ff75b9dd22c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:13 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:13 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:13 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:13 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Deleted volume successfully. Apr 24 15:40:13 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ec32da81-d51d-4612-8b93-c031fc924c01 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-a9056fc1-bc7c-4cb5-869b-e917a6264c95-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-quobyte-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e90c74-feeb-4e04-b094-bc3aa1ac2d01]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:14 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 Apr 24 15:40:14 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:14 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:14 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037 Apr 24 15:40:14 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:15 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037" released by "delete_volume" :: held 1.017s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Created reservations ['6a5c95ba-db60-45af-be26-684a66bfa433', 'db63e7a5-7eb3-458f-a295-2c00f0ad9841', '5cfc5e05-75cd-4261-a72a-4a29ae90999e', '354f82c5-7721-4c9d-80da-6be8cd40ddb5'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:15 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:15 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:15 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.403s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:15 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Deleted volume successfully. Apr 24 15:40:15 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-20c250bf-21ec-42a3-8fc9-058bdeba49fb tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-6bcb67f0-efb9-49ca-a8b9-8c0c4d890037-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-ef179b1b-2889-4242-9df4-84b663b58316-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-ef179b1b-2889-4242-9df4-84b663b58316-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-quobyte-ef179b1b-2889-4242-9df4-84b663b58316" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-ef179b1b-2889-4242-9df4-84b663b58316" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[345a1c11-3886-4686-b216-72a270662953]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:16 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 Apr 24 15:40:16 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:17 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316" returned: 0 in 0.504s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:17 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316 Apr 24 15:40:17 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:17 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-ef179b1b-2889-4242-9df4-84b663b58316" returned: 0 in 0.448s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-ef179b1b-2889-4242-9df4-84b663b58316" released by "delete_volume" :: held 0.992s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Created reservations ['7763bf25-0e62-40c2-b41e-2a2190ed83b3', 'ccb92a5c-2548-4926-9191-11915a404204', 'efd569b7-8308-4cf0-b72c-1ab9e5bb637c', '2fd87f3e-06b0-4efa-b248-6f14dd2999ce'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:17 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:17 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:18 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.445s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:18 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Deleted volume successfully. Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b30b4a99-ee80-4877-a98e-c98c9d7133bf tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-ef179b1b-2889-4242-9df4-84b663b58316-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-4e9838ae-7ac8-4247-b03d-fec6860194b9-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-4e9838ae-7ac8-4247-b03d-fec6860194b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "cinder-quobyte-4e9838ae-7ac8-4247-b03d-fec6860194b9" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-4e9838ae-7ac8-4247-b03d-fec6860194b9" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[831dbbe0-9325-4d15-825f-37e7909cd530]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:18 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 Apr 24 15:40:18 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:19 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9" returned: 0 in 0.589s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:19 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9 Apr 24 15:40:19 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:19 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4e9838ae-7ac8-4247-b03d-fec6860194b9" returned: 0 in 0.448s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-quobyte-4e9838ae-7ac8-4247-b03d-fec6860194b9" released by "delete_volume" :: held 1.082s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Created reservations ['b1a3cbe9-567c-4101-92c7-6e22814e48c4', 'f681fc88-d37e-4b63-b6e1-2724dca32214', 'a0095dd6-85e3-4fda-88d3-068b7580868f', '750a90ac-3572-4c8c-bb28-d6b4570a4601'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:20 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:20 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:20 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.464s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Deleted volume successfully. Apr 24 15:40:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c22291f9-e8f5-4354-8853-b103dce31741 tempest-CreateVolumesFromImageTest-1702315108 None] Lock "cinder-4e9838ae-7ac8-4247-b03d-fec6860194b9-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (a7a7cc72-145a-417c-ae76-0112197c7435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b302435-51ee-4bb6-9c17-cb2b2a1bd3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b302435-51ee-4bb6-9c17-cb2b2a1bd3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859129608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c092338-5319-40b6-a40c-44e7f45cb6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:29Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c301d84-f0fd-45a6-b7f6-d53d5e752340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c301d84-f0fd-45a6-b7f6-d53d5e752340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bb41b5-2ba8-4b94-abe2-0300e10eb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bb41b5-2ba8-4b94-abe2-0300e10eb840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c092338-5319-40b6-a40c-44e7f45cb6a5', 'volume_name': 'volume-8c092338-5319-40b6-a40c-44e7f45cb6a5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372d0baf-4f4c-4e7d-ac35-7379ecf2951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372d0baf-4f4c-4e7d-ac35-7379ecf2951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fab8c-ed67-404a-ba4b-7bc11c405ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume 8c092338-5319-40b6-a40c-44e7f45cb6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c092338-5319-40b6-a40c-44e7f45cb6a5', 'volume_size': 1} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859129608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c092338-5319-40b6-a40c-44e7f45cb6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:29Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume 8c092338-5319-40b6-a40c-44e7f45cb6a5 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:29 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:29 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 1073741824 Apr 24 15:40:29 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (02a8a153-b25b-4914-9805-0d63971de117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d85c4bf-d6fe-4461-8ad5-1c95a9b738a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d85c4bf-d6fe-4461-8ad5-1c95a9b738a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1261528718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca5fe27-b103-45e2-a397-a39d68439385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:29Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d9b14-d646-4827-84f2-108acff20363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d9b14-d646-4827-84f2-108acff20363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c2880e-b8bf-4f3d-8adb-475db4696449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c2880e-b8bf-4f3d-8adb-475db4696449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca5fe27-b103-45e2-a397-a39d68439385', 'volume_name': 'volume-4ca5fe27-b103-45e2-a397-a39d68439385', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dc3447-7ad9-4cea-951d-18b921c82c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dc3447-7ad9-4cea-951d-18b921c82c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb98d06-8886-49d9-897d-488bfa97a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Volume 4ca5fe27-b103-45e2-a397-a39d68439385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca5fe27-b103-45e2-a397-a39d68439385', 'volume_size': 1} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (4cca89ce-b744-404b-a17c-21975fbe6203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe2252b-adb6-4252-b08f-e32eb0eeb1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe2252b-adb6-4252-b08f-e32eb0eeb1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823525199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:30Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c69cd6-4d9d-41af-982d-7287316513e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c69cd6-4d9d-41af-982d-7287316513e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf500ed9-8f12-4797-bc9e-421a4ab64c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf500ed9-8f12-4797-bc9e-421a4ab64c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c', 'volume_name': 'volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a072d569-0639-4e42-a93c-7233d5aa1c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a072d569-0639-4e42-a93c-7233d5aa1c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ff165c-7afd-457f-b27e-a8cd0d80ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:29 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Volume c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c', 'volume_size': 1} Apr 24 15:40:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (3e3ebaa5-d0f3-4e25-aaca-3d58634611b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956a5ed-ad71-4c4f-9298-90b92134a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956a5ed-ad71-4c4f-9298-90b92134a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109054736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8010354a-69ce-4223-93b4-36ff5dfdc139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:30Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b195264-dfc9-4e4b-ab61-ef391e09abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b195264-dfc9-4e4b-ab61-ef391e09abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ceccdb-64d2-478b-bfd6-5bd4b92563bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ceccdb-64d2-478b-bfd6-5bd4b92563bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8010354a-69ce-4223-93b4-36ff5dfdc139', 'volume_name': 'volume-8010354a-69ce-4223-93b4-36ff5dfdc139', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4996c78c-6f87-438a-bcd1-6b2b127fe3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4996c78c-6f87-438a-bcd1-6b2b127fe3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278fc27f-c669-4048-8c44-eab0b5807458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Volume 8010354a-69ce-4223-93b4-36ff5dfdc139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8010354a-69ce-4223-93b4-36ff5dfdc139', 'volume_size': 1} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:30 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 1073741824" returned: 0 in 0.838s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:30 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 Apr 24 15:40:30 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (9f4bcc22-a979-4bc5-8af0-745910ceb9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9a9899-5035-47bf-bfe1-909abad13803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9a9899-5035-47bf-bfe1-909abad13803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212684800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cad4e2-3a51-40ca-8696-124d052c7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9ecc16-e9cf-4d82-b835-1579b8b16d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9ecc16-e9cf-4d82-b835-1579b8b16d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36bd7c9-a402-4109-9e74-bf0bbc0be7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36bd7c9-a402-4109-9e74-bf0bbc0be7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29cad4e2-3a51-40ca-8696-124d052c7f1b', 'volume_name': 'volume-29cad4e2-3a51-40ca-8696-124d052c7f1b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e515bfa-482b-4bdb-8ccb-4007fd394755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e515bfa-482b-4bdb-8ccb-4007fd394755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876ffdb9-7218-4173-956e-a047a0cd36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:30 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Volume 29cad4e2-3a51-40ca-8696-124d052c7f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29cad4e2-3a51-40ca-8696-124d052c7f1b', 'volume_size': 1} Apr 24 15:40:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (4dd07449-3ed0-47b9-bb30-129e1d0b7d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476b018d-89e9-41aa-8418-d2ec8321b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476b018d-89e9-41aa-8418-d2ec8321b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883230237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e333d11-1b96-4cf0-9d80-6518e6ecf308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb20677-f7e9-44f5-8b1e-c9e7ae57c86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb20677-f7e9-44f5-8b1e-c9e7ae57c86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c25a2dc-0bcc-4168-8ab0-8fa84cc89d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c25a2dc-0bcc-4168-8ab0-8fa84cc89d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e333d11-1b96-4cf0-9d80-6518e6ecf308', 'volume_name': 'volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b84d952-1951-4aff-a5ea-616384e7eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b84d952-1951-4aff-a5ea-616384e7eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3741e1-10db-49b1-b430-3e58cc07b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Volume 5e333d11-1b96-4cf0-9d80-6518e6ecf308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308', 'volume_size': 1} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5" returned: 0 in 0.753s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1261528718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca5fe27-b103-45e2-a397-a39d68439385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:29Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Creating volume 4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fab8c-ed67-404a-ba4b-7bc11c405ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c092338-5319-40b6-a40c-44e7f45cb6a5', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d57fc1-afb1-4416-b601-821ac3ef2775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 (8c092338-5319-40b6-a40c-44e7f45cb6a5): created successfully Apr 24 15:40:31 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 1073741824 Apr 24 15:40:31 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d57fc1-afb1-4416-b601-821ac3ef2775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (a7a7cc72-145a-417c-ae76-0112197c7435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-24d2420e-d84c-497a-89e1-bcfced71bda2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (ec3a2a25-5983-48ed-8c2e-e8f1edca18c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ef276-62a7-4121-8b12-675dc294dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ef276-62a7-4121-8b12-675dc294dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1870697470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a5e957-0bd4-4767-bc28-b2c6bf935c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcbaa34-aa7d-4c2f-a811-3f9819c61d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcbaa34-aa7d-4c2f-a811-3f9819c61d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045520f5-7e06-425f-ae37-2a31522745ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045520f5-7e06-425f-ae37-2a31522745ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a5e957-0bd4-4767-bc28-b2c6bf935c17', 'volume_name': 'volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637c83d1-788c-4ca2-8a6d-a13c027b8dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637c83d1-788c-4ca2-8a6d-a13c027b8dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68766006-0a5b-46cf-9289-36132f1f120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Volume 45a5e957-0bd4-4767-bc28-b2c6bf935c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17', 'volume_size': 1} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (c5d43c72-3616-4fa3-8f2b-aa943d9b4709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cddb32b-a96e-4a07-a4e7-709d2bd73c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cddb32b-a96e-4a07-a4e7-709d2bd73c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1788030941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426db312-97fb-4bfe-9caa-43d67d1f09bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b4620f-1e17-4c7f-9b75-6d82dbe0dd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b4620f-1e17-4c7f-9b75-6d82dbe0dd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665a4506-df69-496f-a64d-e5a2462132cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665a4506-df69-496f-a64d-e5a2462132cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426db312-97fb-4bfe-9caa-43d67d1f09bf', 'volume_name': 'volume-426db312-97fb-4bfe-9caa-43d67d1f09bf', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e0dc1a-0610-48fe-a0c0-923b71fb04d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e0dc1a-0610-48fe-a0c0-923b71fb04d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558457d2-4c02-4bb5-8b4e-afc7629293cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:31 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume 426db312-97fb-4bfe-9caa-43d67d1f09bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426db312-97fb-4bfe-9caa-43d67d1f09bf', 'volume_size': 1} Apr 24 15:40:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:32 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 1073741824" returned: 0 in 0.867s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:32 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:40:32 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (bad9e5b5-2972-4283-94e7-dd28cdeec04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b44ca9-6665-477e-a371-324ecc68e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b44ca9-6665-477e-a371-324ecc68e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087972588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db53190-f2b5-4661-a6cc-57a96d95d891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3008f1d3-5be2-49db-a4c0-049cecaf2272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3008f1d3-5be2-49db-a4c0-049cecaf2272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cd98df-2d4b-4d99-9469-4e6b1c08764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cd98df-2d4b-4d99-9469-4e6b1c08764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db53190-f2b5-4661-a6cc-57a96d95d891', 'volume_name': 'volume-4db53190-f2b5-4661-a6cc-57a96d95d891', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b40280b-ddeb-4af6-afef-3c0e22808abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b40280b-ddeb-4af6-afef-3c0e22808abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65900071-433f-446d-8652-8a0a50bd45ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume 4db53190-f2b5-4661-a6cc-57a96d95d891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db53190-f2b5-4661-a6cc-57a96d95d891', 'volume_size': 1} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (b6f2de8c-954f-455c-afa4-feda64515ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551e8b04-c5ab-4d98-be7b-bdb8fff58d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551e8b04-c5ab-4d98-be7b-bdb8fff58d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275474249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47677917-a5f5-4577-861f-1c3d15ed4301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a7b41-48d5-45ee-ac84-fd70a6518623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a7b41-48d5-45ee-ac84-fd70a6518623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c5925d-b374-49ca-8595-a246f3121891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c5925d-b374-49ca-8595-a246f3121891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47677917-a5f5-4577-861f-1c3d15ed4301', 'volume_name': 'volume-47677917-a5f5-4577-861f-1c3d15ed4301', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082bce48-5233-4acd-a05c-5bad90e8171a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082bce48-5233-4acd-a05c-5bad90e8171a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850a47ac-9612-4ecb-b4d2-daebfe7a7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume 47677917-a5f5-4577-861f-1c3d15ed4301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47677917-a5f5-4577-861f-1c3d15ed4301', 'volume_size': 1} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:32 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.734s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823525199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:30Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Creating volume c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:32 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb98d06-8886-49d9-897d-488bfa97a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca5fe27-b103-45e2-a397-a39d68439385', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1baf590-0464-4b57-90ff-160eba973faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:32 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c 1073741824 Apr 24 15:40:32 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:32 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Volume volume-4ca5fe27-b103-45e2-a397-a39d68439385 (4ca5fe27-b103-45e2-a397-a39d68439385): created successfully Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1baf590-0464-4b57-90ff-160eba973faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (02a8a153-b25b-4914-9805-0d63971de117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:32 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-190694b3-c500-4a9a-9ca4-66cc22e4f1aa tempest-VolumeDependencyTests-455430809 None] Created volume successfully. Apr 24 15:40:32 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (a403f4a5-7cf2-4662-9beb-ae0f82ddd4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43eab16-9448-459d-b851-8fd45cc78091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43eab16-9448-459d-b851-8fd45cc78091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042558301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65825d0-a358-4cf6-aecd-2fda87cb38b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:33Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1511b449-034b-4492-a0d5-345184b86d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1511b449-034b-4492-a0d5-345184b86d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3c66f5-2428-4554-a26b-eadd1868e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3c66f5-2428-4554-a26b-eadd1868e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65825d0-a358-4cf6-aecd-2fda87cb38b1', 'volume_name': 'volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fe3af3-b14e-466f-9bf1-a3909c11268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fe3af3-b14e-466f-9bf1-a3909c11268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a33ec3-b187-4633-9ae2-1f11d5f27db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume a65825d0-a358-4cf6-aecd-2fda87cb38b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1', 'volume_size': 1} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (5a938288-893b-4dfd-a6a8-633961462ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c89d37-22fd-4c62-ae90-81024115d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c89d37-22fd-4c62-ae90-81024115d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509242363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3099a722-5945-4e14-837d-f9f6748a78e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:33Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddc7862-83b7-4f69-af6a-1f1c7dbf0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddc7862-83b7-4f69-af6a-1f1c7dbf0636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8bfc5-8863-4f0f-af46-38501f5221ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8bfc5-8863-4f0f-af46-38501f5221ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3099a722-5945-4e14-837d-f9f6748a78e1', 'volume_name': 'volume-3099a722-5945-4e14-837d-f9f6748a78e1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138cecd-4ce8-45c7-ad6d-2bddf0637f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138cecd-4ce8-45c7-ad6d-2bddf0637f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac935f1-e7c9-43d1-baa2-1b60593f8371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:33 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume 3099a722-5945-4e14-837d-f9f6748a78e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3099a722-5945-4e14-837d-f9f6748a78e1', 'volume_size': 1} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:33 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c 1073741824" returned: 0 in 0.797s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:33 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c Apr 24 15:40:33 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:33 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:34 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" returned: 0 in 0.480s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.804s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109054736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8010354a-69ce-4223-93b4-36ff5dfdc139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:30Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Creating volume 8010354a-69ce-4223-93b4-36ff5dfdc139 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:34 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:34 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 1073741824 Apr 24 15:40:34 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ff165c-7afd-457f-b27e-a8cd0d80ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43b93b1-c25a-4d18-ad51-78abac7e668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:34 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Volume volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c (c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c): created successfully Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43b93b1-c25a-4d18-ad51-78abac7e668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (4cca89ce-b744-404b-a17c-21975fbe6203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:34 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-58b2e6bf-3c7a-4a09-b1f5-e7ff8a06953c tempest-CreateVolumesFromImageTest-1519466574 None] Created volume successfully. Apr 24 15:40:34 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 1073741824" returned: 0 in 0.775s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:34 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:34 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 Apr 24 15:40:34 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:35 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139" returned: 0 in 0.470s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.690s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212684800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cad4e2-3a51-40ca-8696-124d052c7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Creating volume 29cad4e2-3a51-40ca-8696-124d052c7f1b {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:35 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278fc27f-c669-4048-8c44-eab0b5807458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8010354a-69ce-4223-93b4-36ff5dfdc139', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b1ab6d-69a9-45de-bd72-d43cb5dc5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:35 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b 1073741824 Apr 24 15:40:35 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:35 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Volume volume-8010354a-69ce-4223-93b4-36ff5dfdc139 (8010354a-69ce-4223-93b4-36ff5dfdc139): created successfully Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b1ab6d-69a9-45de-bd72-d43cb5dc5071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:35 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (3e3ebaa5-d0f3-4e25-aaca-3d58634611b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:35 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d7173a56-aee4-4502-8e3c-6ea40b52dbdf tempest-CreateVolumesFromImageTest-1519466574 None] Created volume successfully. Apr 24 15:40:36 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b 1073741824" returned: 0 in 0.773s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:36 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b Apr 24 15:40:36 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:36 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.694s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883230237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e333d11-1b96-4cf0-9d80-6518e6ecf308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Creating volume 5e333d11-1b96-4cf0-9d80-6518e6ecf308 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:36 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876ffdb9-7218-4173-956e-a047a0cd36fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29cad4e2-3a51-40ca-8696-124d052c7f1b', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c804c52-9bee-4d8c-ac43-0c5655cf44bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:36 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 1073741824 Apr 24 15:40:36 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:36 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Volume volume-29cad4e2-3a51-40ca-8696-124d052c7f1b (29cad4e2-3a51-40ca-8696-124d052c7f1b): created successfully Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c804c52-9bee-4d8c-ac43-0c5655cf44bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:36 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (9f4bcc22-a979-4bc5-8af0-745910ceb9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:36 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-40e926b1-6042-4088-b3e8-4e148e0d894c tempest-CreateVolumesFromImageTest-1519466574 None] Created volume successfully. Apr 24 15:40:37 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 1073741824" returned: 0 in 0.753s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:37 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 Apr 24 15:40:37 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:38 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308" returned: 0 in 0.442s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.581s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1870697470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a5e957-0bd4-4767-bc28-b2c6bf935c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ccb3a459e48d9bba01b3f77de1945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:31Z,use_quota=True,user_id='5670e0094bfa4fbba579cc7f8dab6ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Creating volume 45a5e957-0bd4-4767-bc28-b2c6bf935c17 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:38 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3741e1-10db-49b1-b430-3e58cc07b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cf023d-c63f-4c2b-9866-bd06da743eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:38 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 1073741824 Apr 24 15:40:38 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:38 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Volume volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 (5e333d11-1b96-4cf0-9d80-6518e6ecf308): created successfully Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cf023d-c63f-4c2b-9866-bd06da743eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (4dd07449-3ed0-47b9-bb30-129e1d0b7d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:38 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0a33adb9-3f33-4de5-8fd0-13de4ee8c754 tempest-CreateVolumesFromImageTest-1519466574 None] Created volume successfully. Apr 24 15:40:38 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 1073741824" returned: 0 in 0.705s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:38 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 Apr 24 15:40:38 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:39 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17" returned: 0 in 0.495s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.320s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1788030941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426db312-97fb-4bfe-9caa-43d67d1f09bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume 426db312-97fb-4bfe-9caa-43d67d1f09bf {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:39 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:39 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf 1073741824 Apr 24 15:40:39 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68766006-0a5b-46cf-9289-36132f1f120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e62781-939f-49c7-aa68-76cd631d7930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:39 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Volume volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 (45a5e957-0bd4-4767-bc28-b2c6bf935c17): created successfully Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e62781-939f-49c7-aa68-76cd631d7930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Flow 'volume_create_manager' (ec3a2a25-5983-48ed-8c2e-e8f1edca18c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:39 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b0dc66b6-994c-4acb-b59e-ae68b6b3e970 tempest-CreateVolumesFromImageTest-1519466574 None] Created volume successfully. Apr 24 15:40:39 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf 1073741824" returned: 0 in 0.686s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:40 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf Apr 24 15:40:40 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-45a5e957-0bd4-4767-bc28-b2c6bf935c17-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-45a5e957-0bd4-4767-bc28-b2c6bf935c17-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-quobyte-45a5e957-0bd4-4767-bc28-b2c6bf935c17" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-45a5e957-0bd4-4767-bc28-b2c6bf935c17" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[1017cf13-e1ff-410e-bc8b-3af614c1e6d2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:40 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 Apr 24 15:40:40 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:40 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf" returned: 0 in 0.570s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.268s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087972588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db53190-f2b5-4661-a6cc-57a96d95d891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume 4db53190-f2b5-4661-a6cc-57a96d95d891 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:40 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558457d2-4c02-4bb5-8b4e-afc7629293cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426db312-97fb-4bfe-9caa-43d67d1f09bf', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec9379-ae2d-43b3-b6a9-06b1683f2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:40 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 1073741824 Apr 24 15:40:40 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:40 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-426db312-97fb-4bfe-9caa-43d67d1f09bf (426db312-97fb-4bfe-9caa-43d67d1f09bf): created successfully Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec9379-ae2d-43b3-b6a9-06b1683f2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (c5d43c72-3616-4fa3-8f2b-aa943d9b4709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:40 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1501ce01-fbfb-4f21-a5a0-b8466ee57e55 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:40 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17" returned: 0 in 0.633s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:40 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17 Apr 24 15:40:40 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:41 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-45a5e957-0bd4-4767-bc28-b2c6bf935c17" returned: 0 in 0.509s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:41 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 1073741824" returned: 0 in 0.778s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-45a5e957-0bd4-4767-bc28-b2c6bf935c17" released by "delete_volume" :: held 1.196s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:41 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 Apr 24 15:40:41 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Created reservations ['a3b1815a-fd0c-4635-be50-0b345a33ff8a', 'bc918aff-c850-41bd-89fa-88eb85fd589c', '41c340f9-2382-4e88-ade5-d86c685dd21c', '010df70a-a294-4db3-a7e3-3e22d5de9d07'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:41 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:41 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:42 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891" returned: 0 in 0.565s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.373s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275474249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47677917-a5f5-4577-861f-1c3d15ed4301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:32Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume 47677917-a5f5-4577-861f-1c3d15ed4301 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:42 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:42 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 1073741824 Apr 24 15:40:42 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65900071-433f-446d-8652-8a0a50bd45ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db53190-f2b5-4661-a6cc-57a96d95d891', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d952739-b498-4474-95a8-13927dc48464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:42 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Deleted volume successfully. Apr 24 15:40:42 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-4db53190-f2b5-4661-a6cc-57a96d95d891 (4db53190-f2b5-4661-a6cc-57a96d95d891): created successfully Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d952739-b498-4474-95a8-13927dc48464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (bad9e5b5-2972-4283-94e7-dd28cdeec04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-122204ad-60ae-445a-9919-41c5917a549a tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c4a03ee4-9b55-427d-9a1d-4cd276bccb05 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-45a5e957-0bd4-4767-bc28-b2c6bf935c17-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-5e333d11-1b96-4cf0-9d80-6518e6ecf308-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-5e333d11-1b96-4cf0-9d80-6518e6ecf308-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-quobyte-5e333d11-1b96-4cf0-9d80-6518e6ecf308" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-5e333d11-1b96-4cf0-9d80-6518e6ecf308" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4be53-d2e5-49fa-95f5-f5141a7e9b40]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:42 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 Apr 24 15:40:42 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:42 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 1073741824" returned: 0 in 0.740s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:42 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 Apr 24 15:40:42 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:43 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308" returned: 0 in 0.653s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:43 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308 Apr 24 15:40:43 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:43 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301" returned: 0 in 0.507s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.267s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042558301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65825d0-a358-4cf6-aecd-2fda87cb38b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:33Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume a65825d0-a358-4cf6-aecd-2fda87cb38b1 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:43 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850a47ac-9612-4ecb-b4d2-daebfe7a7253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47677917-a5f5-4577-861f-1c3d15ed4301', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:43 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 1073741824 Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe1ec80-ee82-4441-9e25-210674411b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:43 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:43 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-47677917-a5f5-4577-861f-1c3d15ed4301 (47677917-a5f5-4577-861f-1c3d15ed4301): created successfully Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe1ec80-ee82-4441-9e25-210674411b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (b6f2de8c-954f-455c-afa4-feda64515ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:43 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c9ccdaa5-d6cd-4933-9fc0-937b65e258f2 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:43 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-5e333d11-1b96-4cf0-9d80-6518e6ecf308" returned: 0 in 0.554s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-5e333d11-1b96-4cf0-9d80-6518e6ecf308" released by "delete_volume" :: held 1.267s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Created reservations ['6a62b5a4-c749-4937-80d1-4a4c31654967', 'fbc76335-04a6-45b5-97ab-771e9efe5cbe', '3c94a428-ca69-4348-93ba-35698e406896', 'b3a93f58-c8ff-4589-a141-a8c666083e3c'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:43 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:43 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:44 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 1073741824" returned: 0 in 0.907s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:44 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 Apr 24 15:40:44 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:44 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.684s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Deleted volume successfully. Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d8ebde56-109e-4ed8-ab41-55be5a376be6 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-5e333d11-1b96-4cf0-9d80-6518e6ecf308-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-29cad4e2-3a51-40ca-8696-124d052c7f1b-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-29cad4e2-3a51-40ca-8696-124d052c7f1b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-quobyte-29cad4e2-3a51-40ca-8696-124d052c7f1b" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-29cad4e2-3a51-40ca-8696-124d052c7f1b" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a5c4e-ce88-464a-a322-f372891e79e4]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:44 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b Apr 24 15:40:44 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:44 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1" returned: 0 in 0.696s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.647s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509242363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3099a722-5945-4e14-837d-f9f6748a78e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162603fd875423ab5d80b70fadf8434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:33Z,use_quota=True,user_id='c236a135bf5745fda94c19be895f3872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Creating volume 3099a722-5945-4e14-837d-f9f6748a78e1 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:45 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:45 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 1073741824 Apr 24 15:40:45 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a33ec3-b187-4633-9ae2-1f11d5f27db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3cd7b7-cd79-421d-9206-db37328da511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:45 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 (a65825d0-a358-4cf6-aecd-2fda87cb38b1): created successfully Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3cd7b7-cd79-421d-9206-db37328da511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (a403f4a5-7cf2-4662-9beb-ae0f82ddd4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d38bb427-efb7-4c00-8871-2e759bd40226 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:45 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b" returned: 0 in 0.638s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:45 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b Apr 24 15:40:45 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:45 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 1073741824" returned: 0 in 0.748s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:45 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 Apr 24 15:40:45 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:45 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-29cad4e2-3a51-40ca-8696-124d052c7f1b" returned: 0 in 0.479s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-29cad4e2-3a51-40ca-8696-124d052c7f1b" released by "delete_volume" :: held 1.163s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Created reservations ['948bd543-6fd4-43de-b8f7-1a586fee0f83', '7031a4a7-b094-41fd-a16b-80de6ade5258', '10df1713-3e72-4052-ad9c-8d62ca8b3d92', '8b3cbf02-789a-47cf-bff9-bbf0e27ee21a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:46 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:46 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:46 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1" returned: 0 in 0.531s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.410s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Creating offline snapshot 270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 of volume 4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac935f1-e7c9-43d1-baa2-1b60593f8371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3099a722-5945-4e14-837d-f9f6748a78e1', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7809e46-0894-40a3-9303-c54c62f73135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60eb614-55d9-4082-aadb-6a390c665ec9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:46 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Volume volume-3099a722-5945-4e14-837d-f9f6748a78e1 (3099a722-5945-4e14-837d-f9f6748a78e1): created successfully Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7809e46-0894-40a3-9303-c54c62f73135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Flow 'volume_create_manager' (5a938288-893b-4dfd-a6a8-633961462ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-392426a9-a0f3-47ee-8468-f44b3226e11e tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created volume successfully. Apr 24 15:40:46 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:40:46 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:46 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.616s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Deleted volume successfully. Apr 24 15:40:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-049ea6fc-9b1c-4065-8362-ac22c74db0e7 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-29cad4e2-3a51-40ca-8696-124d052c7f1b-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-8010354a-69ce-4223-93b4-36ff5dfdc139-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-8010354a-69ce-4223-93b4-36ff5dfdc139-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-quobyte-8010354a-69ce-4223-93b4-36ff5dfdc139" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-8010354a-69ce-4223-93b4-36ff5dfdc139" acquired by "delete_volume" :: waited 0.019s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:47 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.742s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3df98da-f3d7-4464-b4b6-c27a9453ac38]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:47 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 1G Apr 24 15:40:47 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:47 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 Apr 24 15:40:47 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-3099a722-5945-4e14-837d-f9f6748a78e1-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-3099a722-5945-4e14-837d-f9f6748a78e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-3099a722-5945-4e14-837d-f9f6748a78e1" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-3099a722-5945-4e14-837d-f9f6748a78e1" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[989325b8-4eaf-4b2e-ab36-5d5c5771d517]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:47 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 Apr 24 15:40:47 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:47 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139" returned: 0 in 0.689s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:47 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139 Apr 24 15:40:47 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:47 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 1G" returned: 0 in 0.848s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca5fe27-b103-45e2-a397-a39d68439385 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:48 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca5fe27-b103-45e2-a397-a39d68439385 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:40:48 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:48 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1" returned: 0 in 0.724s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:48 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1 Apr 24 15:40:48 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:48 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8010354a-69ce-4223-93b4-36ff5dfdc139" returned: 0 in 0.495s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-8010354a-69ce-4223-93b4-36ff5dfdc139" released by "delete_volume" :: held 1.245s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Created reservations ['44668c51-af6e-406b-a258-a6c18b529e48', '6724aea4-e278-4c59-a4b1-e9584db52d09', '385487ee-456b-44d3-992b-2007c25da16e', '4933c418-7599-4460-9aff-800b0c8fac79'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:48 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:48 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:48 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca5fe27-b103-45e2-a397-a39d68439385 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:48 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 is being set with open permissions: ugo+rw Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:48 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:40:48 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:48 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-3099a722-5945-4e14-837d-f9f6748a78e1" returned: 0 in 0.587s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-3099a722-5945-4e14-837d-f9f6748a78e1" released by "delete_volume" :: held 1.370s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['9f2d5ca4-1b71-4b19-bf49-750edd1cf6da', 'b80136ec-2d63-4d2d-8a6b-e955cf9b0088', '6660d3cd-319d-4429-affc-874f6ae3fede', 'ea4659fe-add1-4da8-a6f6-abf5b9e55d2d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:49 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:49 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:49 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:49 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:49 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.656s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Deleted volume successfully. Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-3b74e312-9e26-4752-9778-d0810bd3f859 tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-8010354a-69ce-4223-93b4-36ff5dfdc139-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:49 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.664s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:49 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info Apr 24 15:40:49 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "cinder-quobyte-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[567c2f0b-5895-49e7-8a60-5911742a1f35]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:49 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c Apr 24 15:40:49 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-a65825d0-a358-4cf6-aecd-2fda87cb38b1-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-a65825d0-a358-4cf6-aecd-2fda87cb38b1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:49 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.781s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:49 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-a65825d0-a358-4cf6-aecd-2fda87cb38b1" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.884s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-a65825d0-a358-4cf6-aecd-2fda87cb38b1" acquired by "delete_volume" :: waited 0.025s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa6b164-3b59-4e27-842c-37044659ec1f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-421e0d7c-0dea-402f-8535-8e5fc91071a9 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-3099a722-5945-4e14-837d-f9f6748a78e1-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:50 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 Apr 24 15:40:50 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:50 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info" returned: 0 in 0.860s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:50 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info is being set with open permissions: ugo+rw Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:50 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info Apr 24 15:40:50 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:50 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" returned: 0 in 0.962s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:50 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c Apr 24 15:40:50 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:50 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1" returned: 0 in 0.660s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:50 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1 Apr 24 15:40:50 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:50 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.info" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:50 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-10c42cd0-e984-444a-a5c6-979a78e2e672 tempest-VolumeDependencyTests-455430809 None] Create snapshot completed successfully Apr 24 15:40:51 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-quobyte-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c" released by "delete_volume" :: held 1.667s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Created reservations ['aeb4e1a3-3d3d-42a4-a68d-c5fb69cee575', '87aecfac-4898-45b0-9c89-635eb2935b28', '3fd92c4a-36ff-47e2-b8b4-62891804e9bc', 'fbfcced4-a457-4a76-ab9a-882afe7be626'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:51 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-a65825d0-a358-4cf6-aecd-2fda87cb38b1" returned: 0 in 0.653s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-a65825d0-a358-4cf6-aecd-2fda87cb38b1" released by "delete_volume" :: held 1.359s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:51 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:51 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['cbc25aa6-a54b-46f4-b78f-d8afee0a5ed2', 'dbbb3f48-231c-478a-879b-a765e0db42b7', '0269b5e1-3741-41a3-83f3-54ac54c1e147', 'fb4fd752-49cd-48c3-8c13-37c373804b9e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:51 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:51 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:51 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.531s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Deleted volume successfully. Apr 24 15:40:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-a54b2f46-aa6a-4363-8e23-8d72e20dc3ef tempest-CreateVolumesFromImageTest-1519466574 None] Lock "cinder-c2f1cd0b-448c-4d70-bca9-3b08d2bcd43c-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-47677917-a5f5-4577-861f-1c3d15ed4301-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:52 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-47677917-a5f5-4577-861f-1c3d15ed4301-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.834s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:52 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-47677917-a5f5-4577-861f-1c3d15ed4301" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d254e5d7-64f2-4272-81e2-ec6a83a9ed51 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-a65825d0-a358-4cf6-aecd-2fda87cb38b1-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-47677917-a5f5-4577-861f-1c3d15ed4301" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235fe91-1124-47f8-a2b1-812aaa4a871c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Flow 'volume_create_manager' (c2728b93-4f48-462c-84a7-7852b003f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69dea36-4e4f-4b3a-b5b2-d294ad590bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 Apr 24 15:40:52 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69dea36-4e4f-4b3a-b5b2-d294ad590bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1771256699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b36b56-cab5-4edc-bd5c-f05e9cadcb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecdaa1065724b5599403cd885f8c0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:52Z,use_quota=True,user_id='f4e0169b0d2c416fa189559ba681005c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c48305c-d47b-482a-8490-ee4c5692e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c48305c-d47b-482a-8490-ee4c5692e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfbd388-1003-4225-9650-15a09dca2121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfbd388-1003-4225-9650-15a09dca2121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b36b56-cab5-4edc-bd5c-f05e9cadcb92', 'volume_name': 'volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36bf2fc-22e4-4a02-88e9-d5a7bd9dd8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36bf2fc-22e4-4a02-88e9-d5a7bd9dd8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984484d5-3004-4c09-b7fb-62b924484347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Volume 91b36b56-cab5-4edc-bd5c-f05e9cadcb92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92', 'volume_size': 1} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1771256699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b36b56-cab5-4edc-bd5c-f05e9cadcb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecdaa1065724b5599403cd885f8c0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:52Z,use_quota=True,user_id='f4e0169b0d2c416fa189559ba681005c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Creating volume 91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:52 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:52 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 1073741824 Apr 24 15:40:52 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (c286693f-25ca-487b-bb9e-d0605dc2f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3446b-a3c6-4359-bbb9-85cd7c93d31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3446b-a3c6-4359-bbb9-85cd7c93d31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-880745906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c941c1c-e521-4363-840d-4c372b06431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=270c28cc-fa8d-4b1f-981b-6cb3ad4736d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:52Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073b8b1-291c-415a-9b1f-d012b1f1ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073b8b1-291c-415a-9b1f-d012b1f1ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6966265c-2d3a-4756-8357-55122ac7c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6966265c-2d3a-4756-8357-55122ac7c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c941c1c-e521-4363-840d-4c372b06431f', 'volume_name': 'volume-6c941c1c-e521-4363-840d-4c372b06431f', 'volume_size': 1, 'snapshot_id': '270c28cc-fa8d-4b1f-981b-6cb3ad4736d6'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fda7322-6780-450d-a1a8-8deb6cd05fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fda7322-6780-450d-a1a8-8deb6cd05fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce07910-6911-45a9-9265-bc2c81883319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:52 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Volume 6c941c1c-e521-4363-840d-4c372b06431f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c941c1c-e521-4363-840d-4c372b06431f', 'volume_size': 1, 'snapshot_id': '270c28cc-fa8d-4b1f-981b-6cb3ad4736d6'} Apr 24 15:40:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:53 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301" returned: 0 in 0.717s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:53 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301 Apr 24 15:40:53 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:53 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 1073741824" returned: 0 in 0.767s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:53 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:40:53 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:53 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-47677917-a5f5-4577-861f-1c3d15ed4301" returned: 0 in 0.576s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-47677917-a5f5-4577-861f-1c3d15ed4301" released by "delete_volume" :: held 1.364s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['86b9f255-244e-47f9-95b4-68fc88dca934', '02d02467-0ea3-4066-8349-3ba9c7f10eda', '71fd6d75-0675-41e1-947e-54ec64b3e825', '5fe660d9-17e1-454e-834f-07dd68ba0564'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:53 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:53 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:54 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.564s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.235s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-6c941c1c-e521-4363-840d-4c372b06431f" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984484d5-3004-4c09-b7fb-62b924484347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f9d96f-b78a-4d11-90cb-b08bf65a63d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-6c941c1c-e521-4363-840d-4c372b06431f" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Creating volume 6c941c1c-e521-4363-840d-4c372b06431f from snapshot 270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:54 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Volume volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 (91b36b56-cab5-4edc-bd5c-f05e9cadcb92): created successfully Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f9d96f-b78a-4d11-90cb-b08bf65a63d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Flow 'volume_create_manager' (c2728b93-4f48-462c-84a7-7852b003f52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] snapshot: 270c28cc-fa8d-4b1f-981b-6cb3ad4736d6, volume: 6c941c1c-e521-4363-840d-4c372b06431f, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:40:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-321e4240-d8df-4507-ae8f-dd5455a8805e tempest-SnapshotDependencyTests-211550677 None] Created volume successfully. Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f0630-6759-484f-ac26-a44a989e739f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:54 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:40:54 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:54 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.575s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:54 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d85ff8ec-8460-4298-81cf-cf8b7599c57d tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-47677917-a5f5-4577-861f-1c3d15ed4301-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:54 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.681s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ca5fe27-b103-45e2-a397-a39d68439385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98179f9-767a-4ea3-a085-d586ec5b905d]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-4db53190-f2b5-4661-a6cc-57a96d95d891-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-4db53190-f2b5-4661-a6cc-57a96d95d891-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-4db53190-f2b5-4661-a6cc-57a96d95d891" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:54 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (d5b61ce5-af95-4e73-97f6-a23949525202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9600a495-af80-4577-899d-3e26c1926ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:55 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:40:55 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-4db53190-f2b5-4661-a6cc-57a96d95d891" acquired by "delete_volume" :: waited 0.067s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9600a495-af80-4577-899d-3e26c1926ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935136259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200cda6f-b993-475c-bacb-4935fe2d58d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:55Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247f9a5-1f67-48d1-87d2-4049516f69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247f9a5-1f67-48d1-87d2-4049516f69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c43d30-46b3-4f43-a2a6-0b5a807632cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c43d30-46b3-4f43-a2a6-0b5a807632cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200cda6f-b993-475c-bacb-4935fe2d58d3', 'volume_name': 'volume-200cda6f-b993-475c-bacb-4935fe2d58d3', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fdecd8-f355-4581-b013-bcb98482fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fdecd8-f355-4581-b013-bcb98482fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ffe78-e081-4422-94b8-9ef7a88c92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:40:55 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume 200cda6f-b993-475c-bacb-4935fe2d58d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200cda6f-b993-475c-bacb-4935fe2d58d3', 'volume_size': 1} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e4143-bff1-4c32-887f-6139b4f58692]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:55 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 Apr 24 15:40:55 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:55 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.581s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:55 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f Apr 24 15:40:55 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:55 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891" returned: 0 in 0.541s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:55 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891 Apr 24 15:40:55 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:56 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4db53190-f2b5-4661-a6cc-57a96d95d891" returned: 0 in 0.480s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-4db53190-f2b5-4661-a6cc-57a96d95d891" released by "delete_volume" :: held 1.089s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=118,cinder:INSERT=38,cinder:UPDATE=148,cinder:DELETE=19 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=113,cinder:UPDATE=191,cinder:INSERT=37,cinder:DELETE=14 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['8ffc9c60-c4ee-4716-831a-c75bf50db59d', '2d55e1b3-98c2-4a2b-bbd4-dee1a1707605', '4a57e894-2fb2-44d4-b717-05f48a3578bb', '755ecff7-a51a-489f-9c66-74d91ef3e5ab'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:40:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:56 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:40:56 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-426db312-97fb-4bfe-9caa-43d67d1f09bf-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-426db312-97fb-4bfe-9caa-43d67d1f09bf-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:57 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 1.137s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:40:57 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-426db312-97fb-4bfe-9caa-43d67d1f09bf" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-426db312-97fb-4bfe-9caa-43d67d1f09bf" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-1f67cc87-8f26-413c-b009-07104edc0d08 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-4db53190-f2b5-4661-a6cc-57a96d95d891-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ad636-877a-4f0b-bfba-6da8f185bded]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:40:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:57 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf Apr 24 15:40:57 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:58 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf" returned: 0 in 1.107s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:40:58 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf Apr 24 15:40:58 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:40:59 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 24 15:40:59 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-426db312-97fb-4bfe-9caa-43d67d1f09bf" returned: 0 in 1.093s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:40:59 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-426db312-97fb-4bfe-9caa-43d67d1f09bf" released by "delete_volume" :: held 2.285s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:40:59 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['5324d589-9a15-48c7-8401-cce9fe7ce2d6', 'af06bb2e-87d6-47ce-bba3-8feeade1f30b', '19fe7a31-72de-4410-b9b1-8a694224bfc0', '1a2e4564-70fe-48a4-bd2f-9399aef6e195'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:00 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:00 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:00 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.730s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:00 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-f3ac0af2-7e72-403e-9af9-d29298d44dde tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-426db312-97fb-4bfe-9caa-43d67d1f09bf-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:00 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f" returned: 0 in 5.393s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[182bd221-5aac-4927-805f-7a2bda969b88]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-8c092338-5319-40b6-a40c-44e7f45cb6a5-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:00 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:41:00 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:00 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-8c092338-5319-40b6-a40c-44e7f45cb6a5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "cinder-quobyte-8c092338-5319-40b6-a40c-44e7f45cb6a5" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-8c092338-5319-40b6-a40c-44e7f45cb6a5" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[42364ab6-80a0-4505-804a-5d16f80364a9]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:01 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 Apr 24 15:41:01 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:01 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.742s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:41:01 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Converted 1024.00 MB image at 189.86 MB/s Apr 24 15:41:01 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f is being set with open permissions: ugo+rw Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:01 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f Apr 24 15:41:01 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:01 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5" returned: 0 in 0.613s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:01 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:01 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5 Apr 24 15:41:01 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:02 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f" returned: 0 in 0.507s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" released by "_copy_volume_from_snapshot" :: held 8.021s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-6c941c1c-e521-4363-840d-4c372b06431f" released by "_create_volume_from_snapshot" :: held 8.087s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.130s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.292s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Creating offline snapshot 44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 of volume 91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[98325772-f32a-4633-8d6f-5742bef81a7c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:02 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-8c092338-5319-40b6-a40c-44e7f45cb6a5" returned: 0 in 0.536s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce07910-6911-45a9-9265-bc2c81883319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c941c1c-e521-4363-840d-4c372b06431f', 'volume_size': 1, 'snapshot_id': '270c28cc-fa8d-4b1f-981b-6cb3ad4736d6'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce58726-322b-4c85-9c17-15f838d5cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-quobyte-8c092338-5319-40b6-a40c-44e7f45cb6a5" released by "delete_volume" :: held 1.210s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:02 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Volume volume-6c941c1c-e521-4363-840d-4c372b06431f (6c941c1c-e521-4363-840d-4c372b06431f): created successfully Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce58726-322b-4c85-9c17-15f838d5cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (c286693f-25ca-487b-bb9e-d0605dc2f30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:02 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:02 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-144cc222-2b93-462c-a3a8-fa62c8e3aba1 tempest-VolumeDependencyTests-455430809 None] Created volume successfully. Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Created reservations ['be3658b3-9129-40ae-86c0-2a5f660af32f', 'ca216361-21e0-4f6d-8c24-9d505e2b1ba8', 'af6e3cf8-f1c8-4ced-be5c-d372d9b60970', '57137093-08f2-43e1-8c53-558263bdcc1d'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:02 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:02 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:02 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.668s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:02 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 1G Apr 24 15:41:02 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:02 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.574s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:02 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:02 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Deleted volume successfully. Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ab53aac2-68d3-4da2-893a-b5a994b56b58 tempest-CreateVolumesFromSourceVolumeTest-942505583 None] Lock "cinder-8c092338-5319-40b6-a40c-44e7f45cb6a5-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Deleting offline snapshot 270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 of volume 4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] snapshot_file for this snap is: volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb785ee-6a2e-43d2-a7cf-6f6c7ec42c13]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:03 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:41:03 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:03 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 1G" returned: 0 in 0.917s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:03 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:03 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:03 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:04 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.766s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ca5fe27-b103-45e2-a397-a39d68439385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa6a23-7b16-4f87-8ddf-a646d71d0a15]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:04 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:41:04 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:04 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:04 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 is being set with open permissions: ugo+rw Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:04 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:04 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:04 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.677s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:04 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:04 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:41:04 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:05 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.610s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:05 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info Apr 24 15:41:05 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:05 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.692s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:05 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6 Apr 24 15:41:05 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:05 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:05 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info is being set with open permissions: ugo+rw Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:05 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info Apr 24 15:41:05 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:05 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385.270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" returned: 0 in 0.483s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6" released by "_delete_snapshot" :: held 2.725s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:05 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" released by "delete_snapshot" :: held 2.763s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Created reservations ['6ebcc076-ca3b-4527-a6d6-5ec90d63a0f6', 'eb6e6f95-e636-4d2f-84c7-54a374c96684', '969e0a9a-5860-406c-9574-fb903dfa0301', '3f044e3f-82a9-46d9-a17c-726900dc3cfe'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Delete snapshot completed successfully. Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-d879f64e-4969-4255-aac7-b08c95a69c76 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-270c28cc-fa8d-4b1f-981b-6cb3ad4736d6-delete_snapshot" released by "delete_snapshot" :: held 2.902s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:06 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.info" returned: 0 in 0.492s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.981s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.067s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935136259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200cda6f-b993-475c-bacb-4935fe2d58d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:40:55Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume 200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:06 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:06 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 1073741824 Apr 24 15:41:06 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:06 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5bff7763-42bd-452d-b664-1afbf6938719 tempest-SnapshotDependencyTests-211550677 None] Create snapshot completed successfully Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Flow 'volume_create_manager' (b660d413-c179-42ad-8168-0c2630d5161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b931a-57b9-4bd4-9f52-9ac466293792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b931a-57b9-4bd4-9f52-9ac466293792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c26590-7d85-4490-8194-30126a28b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1638e93dceda4f568e1a06455e2e4fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:06Z,use_quota=True,user_id='4bf1426e64174fa2a152f927f00a30ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e74c7cf-4839-47c0-96eb-c66729ece0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e74c7cf-4839-47c0-96eb-c66729ece0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe02ead-b0cb-4ec9-9ed0-80e4182ff6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe02ead-b0cb-4ec9-9ed0-80e4182ff6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c26590-7d85-4490-8194-30126a28b09e', 'volume_name': 'volume-d4c26590-7d85-4490-8194-30126a28b09e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c687f260-70a4-4f1a-896e-35f4a29366bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c687f260-70a4-4f1a-896e-35f4a29366bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5132d7b-1944-41e7-9c47-52349245b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:06 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Volume d4c26590-7d85-4490-8194-30126a28b09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c26590-7d85-4490-8194-30126a28b09e', 'volume_size': 1} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-4ca5fe27-b103-45e2-a397-a39d68439385-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-4ca5fe27-b103-45e2-a397-a39d68439385-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a26202-e792-4286-b5e7-1be0829f52f6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:06 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:41:06 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:06 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 1073741824" returned: 0 in 0.776s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:06 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:06 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 Apr 24 15:41:06 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Flow 'volume_create_manager' (6966d14e-fbc2-4c1c-8ae8-4fd287ea5dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18ae756-0bd8-42a1-8044-31fa3a8861b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18ae756-0bd8-42a1-8044-31fa3a8861b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d92e923-5123-49aa-98a3-73a09bc7f4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecdaa1065724b5599403cd885f8c0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44e8ed43-1ae8-4590-9bfe-7e1acb47fde6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:07Z,use_quota=True,user_id='f4e0169b0d2c416fa189559ba681005c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88810ef-05f1-4ee7-8958-352e22c02f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88810ef-05f1-4ee7-8958-352e22c02f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0c91b0-efdc-4954-8981-c3f01fe8b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0c91b0-efdc-4954-8981-c3f01fe8b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d92e923-5123-49aa-98a3-73a09bc7f4c0', 'volume_name': 'volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0', 'volume_size': 1, 'snapshot_id': '44e8ed43-1ae8-4590-9bfe-7e1acb47fde6'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063c187-3660-4461-acd6-c224a2e9399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063c187-3660-4461-acd6-c224a2e9399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23764c29-b042-4307-9ac8-b0589bc9f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Volume 9d92e923-5123-49aa-98a3-73a09bc7f4c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0', 'volume_size': 1, 'snapshot_id': '44e8ed43-1ae8-4590-9bfe-7e1acb47fde6'} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:07 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.601s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:07 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385 Apr 24 15:41:07 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:07 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3" returned: 0 in 0.472s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c26590-7d85-4490-8194-30126a28b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1638e93dceda4f568e1a06455e2e4fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:06Z,use_quota=True,user_id='4bf1426e64174fa2a152f927f00a30ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Creating volume d4c26590-7d85-4490-8194-30126a28b09e {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:07 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ffe78-e081-4422-94b8-9ef7a88c92cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200cda6f-b993-475c-bacb-4935fe2d58d3', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e 1073741824 Apr 24 15:41:07 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7daed2a-7437-4c48-b0f2-35e838d0f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:07 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-200cda6f-b993-475c-bacb-4935fe2d58d3 (200cda6f-b993-475c-bacb-4935fe2d58d3): created successfully Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7daed2a-7437-4c48-b0f2-35e838d0f87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (d5b61ce5-af95-4e73-97f6-a23949525202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:07 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c5c518bd-90b2-4daf-94ee-0f389ae0db1c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:07 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-4ca5fe27-b103-45e2-a397-a39d68439385" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-4ca5fe27-b103-45e2-a397-a39d68439385" released by "delete_volume" :: held 1.179s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Created reservations ['a395ff24-cdbb-491d-86c5-b3d2138c5216', 'bdc051a2-4812-415d-85bd-d46528f7caf5', 'bbefe2a2-cb98-4bce-b1fe-196648418d3d', '26964d28-9ceb-4e74-ba36-74977fc65ac7'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:07 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:07 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:07 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:08 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e 1073741824" returned: 0 in 0.730s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:08 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e Apr 24 15:41:08 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:08 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.511s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Deleted volume successfully. Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-46427bd1-1ade-4830-884b-f8cfe2917897 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-4ca5fe27-b103-45e2-a397-a39d68439385-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:08 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e" returned: 0 in 0.471s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.580s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-9d92e923-5123-49aa-98a3-73a09bc7f4c0" by "_create_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-9d92e923-5123-49aa-98a3-73a09bc7f4c0" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Creating volume 9d92e923-5123-49aa-98a3-73a09bc7f4c0 from snapshot 44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5132d7b-1944-41e7-9c47-52349245b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c26590-7d85-4490-8194-30126a28b09e', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58236e65-57b9-4200-be60-a92e7bcaaca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] snapshot: 44e8ed43-1ae8-4590-9bfe-7e1acb47fde6, volume: 9d92e923-5123-49aa-98a3-73a09bc7f4c0, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:41:08 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Volume volume-d4c26590-7d85-4490-8194-30126a28b09e (d4c26590-7d85-4490-8194-30126a28b09e): created successfully Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58236e65-57b9-4200-be60-a92e7bcaaca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Flow 'volume_create_manager' (b660d413-c179-42ad-8168-0c2630d5161c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:08 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-184fac01-429e-4e82-bae0-253953c4f966 tempest-CinderUnicodeTest-758555565 None] Created volume successfully. Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bbd4e-83d2-4eef-885f-d92ff0273bbf]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:08 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:08 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:08 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (c800fed9-e179-43d8-b454-a83be1016237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca945cd-8a4f-4df4-ac5f-be6ccf63245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca945cd-8a4f-4df4-ac5f-be6ccf63245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1468130092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255ad8dc-2f33-4e26-b491-b06eea2e7811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:09Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86badd52-e360-4458-9779-901235cda67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86badd52-e360-4458-9779-901235cda67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838822a7-8881-4445-9757-ae1ea78b534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838822a7-8881-4445-9757-ae1ea78b534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255ad8dc-2f33-4e26-b491-b06eea2e7811', 'volume_name': 'volume-255ad8dc-2f33-4e26-b491-b06eea2e7811', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94f7d13-01d4-4cd7-bdc1-b540f881bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94f7d13-01d4-4cd7-bdc1-b540f881bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242b22a-115a-4dc7-a6cc-3d2b6a1eaf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:09 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Volume 255ad8dc-2f33-4e26-b491-b06eea2e7811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255ad8dc-2f33-4e26-b491-b06eea2e7811', 'volume_size': 1} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:09 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.611s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[0365e66b-541c-4364-a956-07afb3abbf74]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:09 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:09 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Flow 'volume_create_manager' (74aa55ed-8a41-4c6b-84d0-df4790d8c7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:09 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbc946c-407d-4a95-9999-65c305df0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbc946c-407d-4a95-9999-65c305df0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-691076999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26de92-36d2-41f2-99b0-8e6f58413dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1638e93dceda4f568e1a06455e2e4fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:10Z,use_quota=True,user_id='4bf1426e64174fa2a152f927f00a30ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d40279b-af21-4675-925f-64e9020d7820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d40279b-af21-4675-925f-64e9020d7820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca84f25-7227-49f7-80e7-a8f44c04fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca84f25-7227-49f7-80e7-a8f44c04fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb26de92-36d2-41f2-99b0-8e6f58413dee', 'volume_name': 'volume-fb26de92-36d2-41f2-99b0-8e6f58413dee', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674b6b82-6afa-4307-a875-ab19d9d31b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674b6b82-6afa-4307-a875-ab19d9d31b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c897a2-75c9-4826-8e18-9b5d1298628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:10 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Volume fb26de92-36d2-41f2-99b0-8e6f58413dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb26de92-36d2-41f2-99b0-8e6f58413dee', 'volume_size': 1} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:10 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.628s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:41:10 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:10 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 Apr 24 15:41:10 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:14 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0" returned: 0 in 4.735s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:14 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a8504-265d-4a2f-8453-d558e10f6168]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:14 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:14 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:14 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:15 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.677s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:15 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:41:15 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Converted 1024.00 MB image at 216.17 MB/s Apr 24 15:41:15 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 is being set with open permissions: ugo+rw Apr 24 15:41:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:15 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 Apr 24 15:41:15 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:15 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:15 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0" returned: 0 in 0.434s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" released by "_copy_volume_from_snapshot" :: held 7.214s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-9d92e923-5123-49aa-98a3-73a09bc7f4c0" released by "_create_volume_from_snapshot" :: held 7.270s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.289s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.717s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating offline snapshot 0099a981-83f6-4821-8a03-43eeb8990f2a of volume 200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23764c29-b042-4307-9ac8-b0589bc9f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0', 'volume_size': 1, 'snapshot_id': '44e8ed43-1ae8-4590-9bfe-7e1acb47fde6'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0fd36a-17aa-4932-8df2-9acca4b7b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c8a05-12b7-4b83-8fa2-6d84b2bad3cc]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:16 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Volume volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 (9d92e923-5123-49aa-98a3-73a09bc7f4c0): created successfully Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0fd36a-17aa-4932-8df2-9acca4b7b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Flow 'volume_create_manager' (6966d14e-fbc2-4c1c-8ae8-4fd287ea5dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:16 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-7e808dab-148b-45e9-939f-9d0b1c5e63cf tempest-SnapshotDependencyTests-211550677 None] Created volume successfully. Apr 24 15:41:16 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 Apr 24 15:41:16 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:16 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3" returned: 0 in 0.516s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:16 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a 1G Apr 24 15:41:16 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Deleting offline snapshot 44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 of volume 91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] snapshot_file for this snap is: volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3417f08-e3c4-4f61-b466-8e55b949a8c8]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:16 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:17 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:17 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:17 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a 1G" returned: 0 in 0.644s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200cda6f-b993-475c-bacb-4935fe2d58d3 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:17 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200cda6f-b993-475c-bacb-4935fe2d58d3 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a Apr 24 15:41:17 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:17 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.583s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1838b3-5395-4b82-98d0-64aa237485f2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:17 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:17 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:17 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200cda6f-b993-475c-bacb-4935fe2d58d3 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:17 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a is being set with open permissions: ugo+rw Apr 24 15:41:17 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:17 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a Apr 24 15:41:17 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:18 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.534s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:18 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:18 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:18 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a" returned: 0 in 0.440s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:18 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info Apr 24 15:41:18 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:18 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.566s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:18 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6 Apr 24 15:41:18 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:18 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info" returned: 0 in 0.487s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:18 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info is being set with open permissions: ugo+rw Apr 24 15:41:18 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:18 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info Apr 24 15:41:18 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:19 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92.44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" returned: 0 in 0.434s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6" released by "_delete_snapshot" :: held 2.225s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:19 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.info" returned: 0 in 0.446s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" released by "delete_snapshot" :: held 2.280s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.109s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1468130092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255ad8dc-2f33-4e26-b491-b06eea2e7811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:09Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Creating volume 255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:19 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:19 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 1073741824 Apr 24 15:41:19 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-0773d399-787d-4317-8b2a-10faed20eb7a tempest-CreateVolumesFromSnapshotTest-1134455085 None] Create snapshot completed successfully Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Created reservations ['82f48f7e-96dd-4bef-a0e4-a89f1ba635a2', '8a540f69-4bb1-418d-938d-c8ffc075de72', 'a9b6fd5f-263d-4b2d-8597-8e961e22a238', '4e012016-9ea4-4903-a61d-9103e3d71b71'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:19 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Delete snapshot completed successfully. Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-02280fee-aa1a-4805-b571-0831b2f8278e tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-44e8ed43-1ae8-4590-9bfe-7e1acb47fde6-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:19 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 1073741824" returned: 0 in 0.666s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:19 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:19 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:19 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-91b36b56-cab5-4edc-bd5c-f05e9cadcb92-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-91b36b56-cab5-4edc-bd5c-f05e9cadcb92-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (300693de-d537-4131-afce-8802c070655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79ef831-cecb-4d21-9b78-3590cbef4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79ef831-cecb-4d21-9b78-3590cbef4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027020382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e633b7b-9f61-4ddc-aa57-500daabd2404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:20Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e796c97e-cf1d-4514-864d-51fa2c2428cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e796c97e-cf1d-4514-864d-51fa2c2428cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92948100-d3d9-420b-ab16-cadd4e20b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92948100-d3d9-420b-ab16-cadd4e20b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e633b7b-9f61-4ddc-aa57-500daabd2404', 'volume_name': 'volume-6e633b7b-9f61-4ddc-aa57-500daabd2404', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fd5c6d-6af3-4905-8423-6cdfd9010d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fd5c6d-6af3-4905-8423-6cdfd9010d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4378a350-293d-40c0-a3cf-40f2fad89bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume 6e633b7b-9f61-4ddc-aa57-500daabd2404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e633b7b-9f61-4ddc-aa57-500daabd2404', 'volume_size': 1} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" acquired by "delete_volume" :: waited 0.108s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7fddd3-6250-44e5-b4b4-add53022e364]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:20 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:20 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:20 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.610s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.475s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-691076999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26de92-36d2-41f2-99b0-8e6f58413dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1638e93dceda4f568e1a06455e2e4fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:10Z,use_quota=True,user_id='4bf1426e64174fa2a152f927f00a30ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Creating volume fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:20 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:20 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee 1073741824 Apr 24 15:41:20 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (541cddc2-e472-4784-a83f-a448aac28540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bed805-f055-4d3c-a568-338c4d26f22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242b22a-115a-4dc7-a6cc-3d2b6a1eaf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255ad8dc-2f33-4e26-b491-b06eea2e7811', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a67ecb-66c2-4978-ac17-1bb830783d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bed805-f055-4d3c-a568-338c4d26f22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557611630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c0c7a1-4d88-4189-bde5-3879fcb3f13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:20Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1917f-c971-4c8f-864c-943056b4980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1917f-c971-4c8f-864c-943056b4980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022d4b55-6e01-4790-8d28-73ea11477899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022d4b55-6e01-4790-8d28-73ea11477899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c0c7a1-4d88-4189-bde5-3879fcb3f13a', 'volume_name': 'volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c4ec1-52d9-456c-9733-ab40f9a5262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c4ec1-52d9-456c-9733-ab40f9a5262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1bcafe-04ab-4e85-b985-b406b8befca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume 67c0c7a1-4d88-4189-bde5-3879fcb3f13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a', 'volume_size': 1} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:20 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Volume volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 (255ad8dc-2f33-4e26-b491-b06eea2e7811): created successfully Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a67ecb-66c2-4978-ac17-1bb830783d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (c800fed9-e179-43d8-b454-a83be1016237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:20 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-3ceab3fa-e621-4a20-84ad-b92d90c5f4c8 tempest-VolumeDependencyTests-455430809 None] Created volume successfully. Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (e1d52eab-fcc6-44c4-964a-7e286074b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08030ee-f27c-4e18-bfbe-95a65d4fe2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08030ee-f27c-4e18-bfbe-95a65d4fe2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579533814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2716446-8b8b-439b-8a39-cc8e25ade186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:21Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e71d6d5-1489-4e1d-9784-73e425fc6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e71d6d5-1489-4e1d-9784-73e425fc6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d4cab5-353f-4e73-8b5d-471dac4bddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:20 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d4cab5-353f-4e73-8b5d-471dac4bddd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2716446-8b8b-439b-8a39-cc8e25ade186', 'volume_name': 'volume-d2716446-8b8b-439b-8a39-cc8e25ade186', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a50654b-af9b-4e3c-be77-ce479e282a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a50654b-af9b-4e3c-be77-ce479e282a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562a9ae-ba27-4314-b46e-1d100bc4738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume d2716446-8b8b-439b-8a39-cc8e25ade186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2716446-8b8b-439b-8a39-cc8e25ade186', 'volume_size': 1} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:21 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.779s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:21 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92 Apr 24 15:41:21 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (79a511e8-884a-4bc6-ad3b-a006ba8065db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5575ba01-16b9-4fe5-bc28-e1883c718115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5575ba01-16b9-4fe5-bc28-e1883c718115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982160497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8eebf-c33d-4c57-bcf5-0699c0843c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:21Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d452e9-4e46-4f0e-b6a4-73e5c390af6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d452e9-4e46-4f0e-b6a4-73e5c390af6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233aed2-2dea-4739-acec-317ec805a3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233aed2-2dea-4739-acec-317ec805a3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e8eebf-c33d-4c57-bcf5-0699c0843c91', 'volume_name': 'volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6ff871-8823-42d9-a92f-f5df026cdcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6ff871-8823-42d9-a92f-f5df026cdcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a9be64-4c8f-48bb-a056-20f10186bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume 11e8eebf-c33d-4c57-bcf5-0699c0843c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91', 'volume_size': 1} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:21 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee 1073741824" returned: 0 in 0.958s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (db267ae1-4dc9-4fbb-9a21-17d6a927df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de24029a-c9f9-4542-9858-584eea392e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de24029a-c9f9-4542-9858-584eea392e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-321390732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3378319-63b5-4ee7-9252-55789d1bd917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8fc4faf2af4342bb130cb7acc8da27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=255ad8dc-2f33-4e26-b491-b06eea2e7811,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:21Z,use_quota=True,user_id='0865558291ae4a5a9be8c965bde0c41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b82779c-03e4-40b8-9b85-52bc03bbe1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b82779c-03e4-40b8-9b85-52bc03bbe1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4523802d-a080-4a0d-b8c1-d6136184f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4523802d-a080-4a0d-b8c1-d6136184f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd3378319-63b5-4ee7-9252-55789d1bd917', 'volume_name': 'volume-d3378319-63b5-4ee7-9252-55789d1bd917', 'volume_size': 1, 'source_volid': '255ad8dc-2f33-4e26-b491-b06eea2e7811', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a77223-6301-4fb3-b6a6-2057e3146103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a77223-6301-4fb3-b6a6-2057e3146103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e3e5e4-b8b2-4cfe-b1ab-bd7517062cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Volume d3378319-63b5-4ee7-9252-55789d1bd917: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d3378319-63b5-4ee7-9252-55789d1bd917', 'volume_size': 1, 'source_volid': '255ad8dc-2f33-4e26-b491-b06eea2e7811', 'source_volstatus': 'available'} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:21 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee Apr 24 15:41:21 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.flows.manager.create_volume [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81909) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (2ef9a7b7-aaf1-4349-ad17-cab9068654a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b440a-9bab-4da3-a2fb-34992ff4716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b440a-9bab-4da3-a2fb-34992ff4716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021497922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64f27a5-51b7-4bd6-9fff-172cab7da441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:22Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18bf09-4d1a-45dd-a2d4-70ff2957a8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18bf09-4d1a-45dd-a2d4-70ff2957a8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cf7f50-4521-45c1-aee1-39a014e82a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cf7f50-4521-45c1-aee1-39a014e82a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64f27a5-51b7-4bd6-9fff-172cab7da441', 'volume_name': 'volume-c64f27a5-51b7-4bd6-9fff-172cab7da441', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5754be-a50c-4fba-be15-c5c142a82d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5754be-a50c-4fba-be15-c5c142a82d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692a2f21-76c8-475d-8b3d-d31518a11047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:21 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume c64f27a5-51b7-4bd6-9fff-172cab7da441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64f27a5-51b7-4bd6-9fff-172cab7da441', 'volume_size': 1} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:21 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" returned: 0 in 0.664s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-91b36b56-cab5-4edc-bd5c-f05e9cadcb92" released by "delete_volume" :: held 1.501s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Created reservations ['930e6e92-f98b-4379-9d77-ba99d7f1f767', 'a7d64d06-1254-4606-8d74-99f6afdbc53f', 'f316c1cd-9d10-41d0-9253-e5626ee86ee7', 'c961d23c-3027-4449-9bbd-500f88d48e57'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:21 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:21 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:21 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:22 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee" returned: 0 in 0.465s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027020382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e633b7b-9f61-4ddc-aa57-500daabd2404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:20Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume 6e633b7b-9f61-4ddc-aa57-500daabd2404 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:22 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c897a2-75c9-4826-8e18-9b5d1298628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb26de92-36d2-41f2-99b0-8e6f58413dee', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:22 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 1073741824 Apr 24 15:41:22 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c7fe88-c04d-432b-86bc-da1256ae45cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:22 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Volume volume-fb26de92-36d2-41f2-99b0-8e6f58413dee (fb26de92-36d2-41f2-99b0-8e6f58413dee): created successfully Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c7fe88-c04d-432b-86bc-da1256ae45cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Flow 'volume_create_manager' (74aa55ed-8a41-4c6b-84d0-df4790d8c7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-9b40e785-5be1-403c-9dea-9ccc7432e685 tempest-CinderUnicodeTest-758555565 None] Created volume successfully. Apr 24 15:41:22 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.469s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:22 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Deleted volume successfully. Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-bc68d2ed-ef8b-4e45-8790-23f3d22c8df0 tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-91b36b56-cab5-4edc-bd5c-f05e9cadcb92-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-9d92e923-5123-49aa-98a3-73a09bc7f4c0-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-9d92e923-5123-49aa-98a3-73a09bc7f4c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf74dd3-6dd5-4c7a-8449-febe127b635a]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:22 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 Apr 24 15:41:22 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:22 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 1073741824" returned: 0 in 0.688s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:22 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:22 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 Apr 24 15:41:22 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:23 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0" returned: 0 in 0.649s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:23 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0 Apr 24 15:41:23 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:23 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557611630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c0c7a1-4d88-4189-bde5-3879fcb3f13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:20Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume 67c0c7a1-4d88-4189-bde5-3879fcb3f13a {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:23 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4378a350-293d-40c0-a3cf-40f2fad89bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e633b7b-9f61-4ddc-aa57-500daabd2404', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:23 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a 1073741824 Apr 24 15:41:23 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b537824c-e577-46be-a750-3bc54302ab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:23 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 (6e633b7b-9f61-4ddc-aa57-500daabd2404): created successfully Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b537824c-e577-46be-a750-3bc54302ab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (300693de-d537-4131-afce-8802c070655d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:23 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-a9ef1741-b465-4d3e-80cb-435e33bb41a8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:23 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-9d92e923-5123-49aa-98a3-73a09bc7f4c0" returned: 0 in 0.572s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-quobyte-9d92e923-5123-49aa-98a3-73a09bc7f4c0" released by "delete_volume" :: held 1.261s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Created reservations ['23fd904c-1d3e-46da-b3c9-8a84e437151d', 'beb60c00-9c92-457c-a3bc-b1f222bf4845', 'cecf8371-ad48-4010-a4c5-8df52e290926', 'db0514c7-4477-4c53-8c41-26843949e9fc'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:23 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:23 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:23 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:24 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a 1073741824" returned: 0 in 0.684s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:24 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a Apr 24 15:41:24 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:24 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Deleted volume successfully. Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-6cee50ac-3e22-4c65-a4fb-45caf8c78b8a tempest-SnapshotDependencyTests-211550677 None] Lock "cinder-9d92e923-5123-49aa-98a3-73a09bc7f4c0-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:24 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" returned: 0 in 0.471s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.581s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579533814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2716446-8b8b-439b-8a39-cc8e25ade186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:21Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume d2716446-8b8b-439b-8a39-cc8e25ade186 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:24 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1bcafe-04ab-4e85-b985-b406b8befca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:24 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 1073741824 Apr 24 15:41:24 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4145e9-33b6-486b-9f64-b3bdb3aa1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:24 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a (67c0c7a1-4d88-4189-bde5-3879fcb3f13a): created successfully Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4145e9-33b6-486b-9f64-b3bdb3aa1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:24 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (541cddc2-e472-4784-a83f-a448aac28540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:24 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b97a92ee-ec94-4266-ad4e-4b0389e2af98 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:25 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 1073741824" returned: 0 in 0.682s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:25 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 Apr 24 15:41:25 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:25 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186" returned: 0 in 0.524s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.412s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982160497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8eebf-c33d-4c57-bcf5-0699c0843c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:21Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume 11e8eebf-c33d-4c57-bcf5-0699c0843c91 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:25 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:25 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 1073741824 Apr 24 15:41:25 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562a9ae-ba27-4314-b46e-1d100bc4738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2716446-8b8b-439b-8a39-cc8e25ade186', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f0dcf-6520-48ac-a617-cd6b4484e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:25 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-d2716446-8b8b-439b-8a39-cc8e25ade186 (d2716446-8b8b-439b-8a39-cc8e25ade186): created successfully Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f0dcf-6520-48ac-a617-cd6b4484e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:25 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (e1d52eab-fcc6-44c4-964a-7e286074b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:25 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-80acc671-673d-40ee-a7f3-c288aafbf4fc tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:26 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 1073741824" returned: 0 in 0.758s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:26 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:26 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 Apr 24 15:41:26 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:27 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91" returned: 0 in 0.528s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.517s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:27 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Cloning volume 255ad8dc-2f33-4e26-b491-b06eea2e7811 to volume d3378319-63b5-4ee7-9252-55789d1bd917 Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a9be64-4c8f-48bb-a056-20f10186bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4640b88e-ac60-400f-a576-904432606daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:27 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 (11e8eebf-c33d-4c57-bcf5-0699c0843c91): created successfully Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4640b88e-ac60-400f-a576-904432606daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (79a511e8-884a-4bc6-ad3b-a006ba8065db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:27 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b9da0b6e-ef27-4ed5-acef-9c52ab8ce61f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Creating offline snapshot 03fa6bdc-db39-4595-9747-dabfbd3dcc10 of volume 255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d273be-e368-4b75-a037-872edb0b825e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:27 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:27 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:27 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:28 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.705s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:28 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 1G Apr 24 15:41:28 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:28 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 1G" returned: 0 in 0.732s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:28 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:28 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:28 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:29 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.603s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:29 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 is being set with open permissions: ugo+rw Apr 24 15:41:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:29 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:29 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:29 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.531s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:29 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:29 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info Apr 24 15:41:29 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:30 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info" returned: 0 in 0.513s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:30 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info is being set with open permissions: ugo+rw Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:30 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info Apr 24 15:41:30 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:30 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.info" returned: 0 in 0.478s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" by "_copy_volume_from_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] snapshot: 03fa6bdc-db39-4595-9747-dabfbd3dcc10, volume: d3378319-63b5-4ee7-9252-55789d1bd917, {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e6cadd-70c3-4bdd-979f-0ebb476aa56b]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:30 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:31 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:31 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:31 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.655s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-255ad8dc-2f33-4e26-b491-b06eea2e7811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Creating direct copy from snapshot {{(pid=81909) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[daafc3b2-31f0-480f-8da5-cee529645bfd]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:31 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:31 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:31 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:32 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.728s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:32 devstack cinder-volume[81909]: DEBUG cinder.utils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Path /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 not found in is_blk_device check {{(pid=81909) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 15:41:32 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:32 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 Apr 24 15:41:32 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:37 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917" returned: 0 in 4.962s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:37 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84f049-5744-4f28-b81c-6c24002ee84e]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:37 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:37 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:37 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:37 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.629s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:37 devstack cinder-volume[81909]: DEBUG cinder.image.image_utils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 {{(pid=81909) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 15:41:37 devstack cinder-volume[81909]: INFO cinder.image.image_utils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Converted 1024.00 MB image at 206.30 MB/s Apr 24 15:41:37 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 is being set with open permissions: ugo+rw Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:38 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 Apr 24 15:41:38 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:38 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917" returned: 0 in 0.416s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" released by "_copy_volume_from_snapshot" :: held 7.478s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-03fa6bdc-db39-4595-9747-dabfbd3dcc10" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-03fa6bdc-db39-4595-9747-dabfbd3dcc10" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Deleting offline snapshot 03fa6bdc-db39-4595-9747-dabfbd3dcc10 of volume 255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] snapshot_file for this snap is: volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801fb5a-200b-4763-bbff-3d05847d5e25]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:38 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:38 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:38 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:39 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.545s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-255ad8dc-2f33-4e26-b491-b06eea2e7811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c985f4f-55df-4997-a252-8bf8aad491d3]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:39 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:39 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:39 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.551s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:39 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:39 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:39 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=99,cinder:SELECT=78,cinder:DELETE=10,cinder:INSERT=22 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:41:40 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.538s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:40 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10 Apr 24 15:41:40 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:40 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811.03fa6bdc-db39-4595-9747-dabfbd3dcc10" returned: 0 in 0.439s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-03fa6bdc-db39-4595-9747-dabfbd3dcc10" released by "_delete_snapshot" :: held 2.162s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.434s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.885s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021497922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64f27a5-51b7-4bd6-9fff-172cab7da441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270c7ef90304cada454af2da260e76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T13:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T13:41:22Z,use_quota=True,user_id='e065fe548a2c4c79a7f75d1d8d478a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(982eeed0-0248-4e50-af09-d3070314ec03),volume_type_id=982eeed0-0248-4e50-af09-d3070314ec03)}" {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Creating volume c64f27a5-51b7-4bd6-9fff-172cab7da441 {{(pid=81909) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Selected osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e as target Quobyte volume. {{(pid=81909) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 15:41:40 devstack cinder-volume[81909]: INFO cinder.volume.drivers.remotefs [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] casted to osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 1073741824 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:40 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 1073741824 Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e3e5e4-b8b2-4cfe-b1ab-bd7517062cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3378319-63b5-4ee7-9252-55789d1bd917', 'volume_size': 1, 'source_volid': '255ad8dc-2f33-4e26-b491-b06eea2e7811', 'source_volstatus': 'available'}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:40 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff64de-1cb1-4184-a4bd-f50ebd509b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:40 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Volume volume-d3378319-63b5-4ee7-9252-55789d1bd917 (d3378319-63b5-4ee7-9252-55789d1bd917): created successfully Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff64de-1cb1-4184-a4bd-f50ebd509b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Flow 'volume_create_manager' (db267ae1-4dc9-4fbb-9a21-17d6a927df48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:40 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-587530fb-626f-4a85-85f8-a7632d213c24 tempest-VolumeDependencyTests-455430809 None] Created volume successfully. Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-255ad8dc-2f33-4e26-b491-b06eea2e7811-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:40 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-255ad8dc-2f33-4e26-b491-b06eea2e7811-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-255ad8dc-2f33-4e26-b491-b06eea2e7811" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-255ad8dc-2f33-4e26-b491-b06eea2e7811" acquired by "delete_volume" :: waited 0.016s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc298e8a-f4ae-4410-8ca9-bbf66dc332c7]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:41 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:41 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:41 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 1073741824" returned: 0 in 0.762s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:41 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 Apr 24 15:41:41 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:41 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.584s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:41 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811 Apr 24 15:41:41 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:41 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441" returned: 0 in 0.449s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'} {{(pid=81909) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.601s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692a2f21-76c8-475d-8b3d-d31518a11047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64f27a5-51b7-4bd6-9fff-172cab7da441', 'volume_size': 1}' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e09047-00c8-447d-a384-f44e8e1143aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Creating offline snapshot ca49b31f-aa7a-4edc-9590-ff86bb428b5f of volume fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 15:41:41 devstack cinder-volume[81909]: INFO cinder.volume.flows.manager.create_volume [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Volume volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 (c64f27a5-51b7-4bd6-9fff-172cab7da441): created successfully Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e09047-00c8-447d-a384-f44e8e1143aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81909) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Flow 'volume_create_manager' (2ef9a7b7-aaf1-4349-ad17-cab9068654a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81909) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb010f-9f1c-4c14-af9f-951277272c85]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:41 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-05917ca1-c62d-4349-9278-bf1626f421ad tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created volume successfully. Apr 24 15:41:42 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee Apr 24 15:41:42 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:42 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-255ad8dc-2f33-4e26-b491-b06eea2e7811" returned: 0 in 0.479s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-255ad8dc-2f33-4e26-b491-b06eea2e7811" released by "delete_volume" :: held 1.120s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Created reservations ['b65ebabe-ca55-4872-8fab-e9fa01aecceb', 'a078edd5-c23d-4c10-9da0-9b4194349508', '05cf9001-df96-4109-bca4-138d2ffbc1e2', '97574861-4ba1-4313-9d6a-810da70be708'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:42 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:42 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:42 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee" returned: 0 in 0.617s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f 1G {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:42 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f 1G Apr 24 15:41:42 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-c64f27a5-51b7-4bd6-9fff-172cab7da441-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:42 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-c64f27a5-51b7-4bd6-9fff-172cab7da441-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.479s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:42 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Deleted volume successfully. Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-c0bb7d17-730b-4ab8-b981-bee8adb23cd9 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-255ad8dc-2f33-4e26-b491-b06eea2e7811-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-c64f27a5-51b7-4bd6-9fff-172cab7da441" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:42 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-c64f27a5-51b7-4bd6-9fff-172cab7da441" acquired by "delete_volume" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed3c3d-ce56-487b-8ab3-93dd4329b2b6]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 Apr 24 15:41:43 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-d3378319-63b5-4ee7-9252-55789d1bd917-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "cinder-d3378319-63b5-4ee7-9252-55789d1bd917-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" acquired by "delete_volume" :: waited 0.018s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:43 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13169bb-1bb8-4c2a-883d-b8fdb4f4be61]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f 1G" returned: 0 in 0.700s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb26de92-36d2-41f2-99b0-8e6f58413dee -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb26de92-36d2-41f2-99b0-8e6f58413dee -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f Apr 24 15:41:43 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:43 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 Apr 24 15:41:43 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:43 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441" returned: 0 in 0.560s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441 Apr 24 15:41:43 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:43 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb26de92-36d2-41f2-99b0-8e6f58413dee -F qcow2 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f" returned: 0 in 0.502s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:43 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f is being set with open permissions: ugo+rw Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:43 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917" returned: 0 in 0.540s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:43 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:43 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:43 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917 Apr 24 15:41:43 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:44 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-c64f27a5-51b7-4bd6-9fff-172cab7da441" returned: 0 in 0.455s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-c64f27a5-51b7-4bd6-9fff-172cab7da441" released by "delete_volume" :: held 1.067s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['61fbd22c-dd21-4e50-91bc-80ee618eaae4', '15f8a53f-0237-4d2e-a887-1b4716e5cd5c', 'a23801bb-414d-4319-bba4-a8cd0fc88b97', 'b8c09786-8576-40af-8a12-ecb3823a2fa2'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:44 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:44 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:44 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f" returned: 0 in 0.443s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:44 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info Apr 24 15:41:44 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:44 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d3378319-63b5-4ee7-9252-55789d1bd917" returned: 0 in 0.510s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-d3378319-63b5-4ee7-9252-55789d1bd917" released by "delete_volume" :: held 1.091s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Created reservations ['3554076b-7957-452b-8245-3d09da7f8318', '16da321d-e551-4ee6-a2b9-6bdce168ee00', '796c35ef-e35a-49ca-a84b-26a459be8f0b', 'd8245c44-05a2-4ee9-9545-3a0c4ef5523e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:44 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:44 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:44 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.450s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:44 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-433e4387-a105-40cf-86c2-6b85741527c8 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-c64f27a5-51b7-4bd6-9fff-172cab7da441-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:44 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info" returned: 0 in 0.508s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: WARNING cinder.volume.drivers.remotefs [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info is being set with open permissions: ugo+rw Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:44 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info Apr 24 15:41:44 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-11e8eebf-c33d-4c57-bcf5-0699c0843c91-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:44 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.489s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:44 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-11e8eebf-c33d-4c57-bcf5-0699c0843c91-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Deleted volume successfully. Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-11e8eebf-c33d-4c57-bcf5-0699c0843c91" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-581a57a4-573f-49fb-bd6d-83ea419f172a tempest-VolumeDependencyTests-455430809 None] Lock "cinder-d3378319-63b5-4ee7-9252-55789d1bd917-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-11e8eebf-c33d-4c57-bcf5-0699c0843c91" acquired by "delete_volume" :: waited 0.033s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7e3a0-0e1a-46ca-9b7c-f35e08e3f33f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:45 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 Apr 24 15:41:45 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:45 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.info" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:45 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-198d4029-9138-4dcf-b715-ceae8cc83ca2 tempest-CinderUnicodeTest-758555565 None] Create snapshot completed successfully Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-6c941c1c-e521-4363-840d-4c372b06431f-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-6c941c1c-e521-4363-840d-4c372b06431f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2771ee-09b0-44fc-a40e-f1e59550081f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:45 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f Apr 24 15:41:45 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:45 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91" returned: 0 in 0.621s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:45 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:45 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91 Apr 24 15:41:45 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:46 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f" returned: 0 in 0.562s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:46 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f Apr 24 15:41:46 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:46 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-11e8eebf-c33d-4c57-bcf5-0699c0843c91" returned: 0 in 0.497s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-11e8eebf-c33d-4c57-bcf5-0699c0843c91" released by "delete_volume" :: held 1.177s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-ca49b31f-aa7a-4edc-9590-ff86bb428b5f-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-ca49b31f-aa7a-4edc-9590-ff86bb428b5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-quobyte-ca49b31f-aa7a-4edc-9590-ff86bb428b5f" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['6c151d9a-9c47-48d3-8ae0-cc19791bab5e', '468ad9e7-66c3-4bd4-aa53-3e3d0f9ee62c', 'd24e127b-331a-4728-802c-8dd24b07f200', '3dfab6d7-2105-4394-9447-1a1d5c9462b3'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-ca49b31f-aa7a-4edc-9590-ff86bb428b5f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Deleting offline snapshot ca49b31f-aa7a-4edc-9590-ff86bb428b5f of volume fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] snapshot_file for this snap is: volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eab1e6-9ded-4d55-96f9-615d1237d1b2]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:46 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:46 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:46 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f Apr 24 15:41:46 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:46 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6c941c1c-e521-4363-840d-4c372b06431f" returned: 0 in 0.576s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-quobyte-6c941c1c-e521-4363-840d-4c372b06431f" released by "delete_volume" :: held 1.195s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Created reservations ['07666e56-7bd3-40d8-9468-15f0cfb8a258', 'bdde6077-1f67-4373-949a-124af28da3c2', '7c7b59b4-9b03-4368-afca-9131ce36dcdd', '8b7271ba-53bb-4704-82d6-ac9245bf9f4a'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:46 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:46 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:46 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.523s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:46 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:46 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f" returned: 0 in 0.613s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:46 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb26de92-36d2-41f2-99b0-8e6f58413dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[876123e5-f55c-44ad-b500-dd20035bb08c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-ffe2f33b-689f-47d7-97e2-563199e0f803 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-11e8eebf-c33d-4c57-bcf5-0699c0843c91-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:47 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee Apr 24 15:41:47 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-d2716446-8b8b-439b-8a39-cc8e25ade186-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-d2716446-8b8b-439b-8a39-cc8e25ade186-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-d2716446-8b8b-439b-8a39-cc8e25ade186" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-d2716446-8b8b-439b-8a39-cc8e25ade186" acquired by "delete_volume" :: waited 0.034s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd8a9b2-2ed6-4fad-8297-608286b70c24]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:47 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.500s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:47 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Deleted volume successfully. Apr 24 15:41:47 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 Apr 24 15:41:47 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-610ac059-6694-4a2e-a5f2-57e6a78c65e5 tempest-VolumeDependencyTests-455430809 None] Lock "cinder-6c941c1c-e521-4363-840d-4c372b06431f-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:47 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee" returned: 0 in 0.595s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:47 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f Apr 24 15:41:47 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:47 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186" returned: 0 in 0.582s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:47 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:47 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186 Apr 24 15:41:47 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:48 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f" returned: 0 in 0.596s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:48 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f Apr 24 15:41:48 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:48 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d2716446-8b8b-439b-8a39-cc8e25ade186" returned: 0 in 0.512s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-d2716446-8b8b-439b-8a39-cc8e25ade186" released by "delete_volume" :: held 1.164s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['a32ed368-c6de-454e-9a2c-36d40b5aee31', '7889ebd2-d419-4920-9ecc-14b951c90d43', 'fa3670e1-921f-4300-9fcd-23e4bf59ed83', 'd4c70ff1-cabe-450e-8567-207e331fabb9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:48 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:48 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:48 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee.ca49b31f-aa7a-4edc-9590-ff86bb428b5f" returned: 0 in 0.597s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-ca49b31f-aa7a-4edc-9590-ff86bb428b5f" released by "_delete_snapshot" :: held 2.525s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" released by "delete_snapshot" :: held 2.561s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:48 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Created reservations ['8fd2c823-8434-4141-8207-f53cb35f4736', '4a297f3e-c9e6-415a-adea-55f6233bb5c5', '6b49fb99-fb36-422c-b4c1-27ee21133880', '2119a0ab-b1f4-45b8-897d-b1acc233a8b5'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Delete snapshot completed successfully. Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-5d5a3181-1e1e-4a86-a563-e1672f2994d5 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-ca49b31f-aa7a-4edc-9590-ff86bb428b5f-delete_snapshot" released by "delete_snapshot" :: held 2.745s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_service.periodic_task [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81909) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:49 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:49 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:49 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.543s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:49 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-80c47f94-9c2e-40e1-9a21-c48245899b5c tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-d2716446-8b8b-439b-8a39-cc8e25ade186-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-fb26de92-36d2-41f2-99b0-8e6f58413dee-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-67c0c7a1-4d88-4189-bde5-3879fcb3f13a-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-fb26de92-36d2-41f2-99b0-8e6f58413dee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-67c0c7a1-4d88-4189-bde5-3879fcb3f13a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" acquired by "delete_volume" :: waited 0.035s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" acquired by "delete_volume" :: waited 0.042s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7744a92-3aa0-4a70-84c6-49c53c732640]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c9805-0e1d-42e4-b3e6-e82f9cd48567]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:49 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.581s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:49 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-24a4d514-83a8-4ad4-9a61-8056b6a0fed6 None None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:49 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee Apr 24 15:41:49 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:49 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a Apr 24 15:41:49 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:50 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee" returned: 0 in 0.517s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:50 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee Apr 24 15:41:50 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:50 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" returned: 0 in 0.529s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:50 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a Apr 24 15:41:50 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:50 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-fb26de92-36d2-41f2-99b0-8e6f58413dee" returned: 0 in 0.435s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-fb26de92-36d2-41f2-99b0-8e6f58413dee" released by "delete_volume" :: held 1.020s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:50 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Created reservations ['e2a953b7-6227-4b9f-86c5-31110f038bec', '893e1c18-8184-42a0-ad3a-42f6892c2ad9', '5fb12f3d-4180-48ed-9c04-8f64b4b8ee61', '1f2221bc-9d34-4b16-aa06-b12db2dca02b'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" returned: 0 in 0.499s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-67c0c7a1-4d88-4189-bde5-3879fcb3f13a" released by "delete_volume" :: held 1.073s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:50 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:50 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['bc6eea02-1566-45c2-a66d-ab06144b893e', 'a2f1ed35-9195-4709-a3f0-abf312f61204', '863b703b-2bfd-4f6b-b4da-969c8f6a1424', '1aeaedea-68a6-4cce-a486-71693312011e'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:50 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:50 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:50 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:51 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.413s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Deleted volume successfully. Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-e643d18d-4de0-4bb8-bdfe-5831f473c117 tempest-CinderUnicodeTest-758555565 None] Lock "cinder-fb26de92-36d2-41f2-99b0-8e6f58413dee-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:51 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.459s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:51 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-895f79e0-f660-4736-80dc-c2cf0d2f719f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-67c0c7a1-4d88-4189-bde5-3879fcb3f13a-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-d4c26590-7d85-4490-8194-30126a28b09e-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-6e633b7b-9f61-4ddc-aa57-500daabd2404-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "cinder-d4c26590-7d85-4490-8194-30126a28b09e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-6e633b7b-9f61-4ddc-aa57-500daabd2404-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Acquiring lock "cinder-quobyte-d4c26590-7d85-4490-8194-30126a28b09e" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-d4c26590-7d85-4490-8194-30126a28b09e" acquired by "delete_volume" :: waited 0.026s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-6e633b7b-9f61-4ddc-aa57-500daabd2404" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f9a98d-1fe7-482a-adab-86c9b4e38520]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-6e633b7b-9f61-4ddc-aa57-500daabd2404" acquired by "delete_volume" :: waited 0.022s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e01c0c-b7eb-4e3a-8c5b-a12b0068740f]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:51 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:51 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e Apr 24 15:41:51 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:51 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 Apr 24 15:41:51 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:52 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e" returned: 0 in 0.518s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:52 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e Apr 24 15:41:52 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:52 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404" returned: 0 in 0.519s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:52 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404 Apr 24 15:41:52 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:52 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-d4c26590-7d85-4490-8194-30126a28b09e" returned: 0 in 0.457s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "cinder-quobyte-d4c26590-7d85-4490-8194-30126a28b09e" released by "delete_volume" :: held 1.017s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:52 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-6e633b7b-9f61-4ddc-aa57-500daabd2404" returned: 0 in 0.467s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-6e633b7b-9f61-4ddc-aa57-500daabd2404" released by "delete_volume" :: held 1.033s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Created reservations ['ddb7de31-a75d-4f87-a1a4-2ea329d76c9b', 'fba69010-dbef-4e03-9bcd-6d950d464272', '3e43af0b-d700-4a22-a99d-3c65ba9978bf', '98bc7bc2-6c8a-4994-a02e-55326feac213'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:52 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['b0f1be40-97d4-4aad-ae85-237432797a77', '826ee3aa-c5f7-48cc-926b-c2c337b6e2e1', '029a3a31-8f0c-498b-9aba-7d18f8a10b1d', '8061faa1-f8f8-4fe9-b3a6-ea94e6fd53f9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:53 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:53 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:53 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:53 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:53 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.445s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Deleted volume successfully. Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-efeb4e58-0ef0-43de-bbdb-fcd1ef356f8c tempest-CinderUnicodeTest-758555565 None] Lock "cinder-d4c26590-7d85-4490-8194-30126a28b09e-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:53 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.473s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:53 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-b70fe683-4ad0-41e5-ae02-43f988ee1c2f tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-6e633b7b-9f61-4ddc-aa57-500daabd2404-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:53 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-0099a981-83f6-4821-8a03-43eeb8990f2a-delete_snapshot" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-0099a981-83f6-4821-8a03-43eeb8990f2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" by "delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" acquired by "delete_snapshot" :: waited 0.076s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-0099a981-83f6-4821-8a03-43eeb8990f2a" by "_delete_snapshot" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-0099a981-83f6-4821-8a03-43eeb8990f2a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleting offline snapshot 0099a981-83f6-4821-8a03-43eeb8990f2a of volume 200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] snapshot_file for this snap is: volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[10763743-abc5-4526-846a-7eaec84a7433]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:54 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a Apr 24 15:41:54 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:54 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a" returned: 0 in 0.624s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.remotefs [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-200cda6f-b993-475c-bacb-4935fe2d58d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81909) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b5c3a-045a-48e3-90ed-ad853819093c]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:54 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:54 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 Apr 24 15:41:54 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:55 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3" returned: 0 in 0.580s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:55 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a Apr 24 15:41:55 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:55 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a" returned: 0 in 0.563s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:55 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:55 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a Apr 24 15:41:55 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:56 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3.0099a981-83f6-4821-8a03-43eeb8990f2a" returned: 0 in 0.450s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=121,cinder:INSERT=50,cinder:UPDATE=168,cinder:DELETE=12 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-0099a981-83f6-4821-8a03-43eeb8990f2a" released by "_delete_snapshot" :: held 2.342s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" released by "delete_snapshot" :: held 2.369s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['0290e9bc-8427-40ba-88f5-2ecbf6ebcb49', '8b40ddf1-0227-4459-a104-0f2a101b231c', 'f9cc382f-7900-43ad-b9c6-e6b2184a738e', '4ce5a7d7-1ab1-4856-9f8c-09ff5e846eb9'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:56 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Delete snapshot completed successfully. Apr 24 15:41:56 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-af1852e3-1814-418e-b820-7dc90c77d5ea tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-0099a981-83f6-4821-8a03-43eeb8990f2a-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-200cda6f-b993-475c-bacb-4935fe2d58d3-delete_volume" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-200cda6f-b993-475c-bacb-4935fe2d58d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" by "delete_volume" {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" acquired by "delete_volume" :: waited 0.015s {{(pid=81909) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c98f3-f9e5-4f00-92b9-25fb92e99187]: (4, 'qcow2') {{(pid=82800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:57 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 Apr 24 15:41:57 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:57 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3" returned: 0 in 0.547s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:57 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:57 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3 Apr 24 15:41:57 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:58 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2/volume-200cda6f-b993-475c-bacb-4935fe2d58d3" returned: 0 in 0.454s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-quobyte-200cda6f-b993-475c-bacb-4935fe2d58d3" released by "delete_volume" :: held 1.069s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.quota [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Created reservations ['0dad15c3-01df-4bdb-bea8-1aeed1774f89', '666e5773-8fd4-46c7-bcc7-b97acddb59f1', 'aa36fee6-06f6-46b3-bc14-015fb17282fc', '76997665-eb30-4b0d-9302-cb0707e85f35'] {{(pid=81909) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e': None} {{(pid=81909) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.volume.drivers.quobyte [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4c128cb-202e-4cbe-9769-eb3b21f63f2e'] {{(pid=81909) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.lockutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81909) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 15:41:58 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2 Apr 24 15:41:58 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 15:41:58 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG oslo_concurrency.processutils [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ddb6259950b9921be5b91abee87e3f2" returned: 0 in 0.459s {{(pid=81909) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.manager [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Notifying Schedulers of capabilities ... {{(pid=81909) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 15:41:58 devstack cinder-volume[81909]: INFO cinder.volume.manager [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Deleted volume successfully. Apr 24 15:41:58 devstack cinder-volume[81909]: DEBUG cinder.coordination [None req-26ef82d5-67e7-44f8-afc1-3bf836bee787 tempest-CreateVolumesFromSnapshotTest-1134455085 None] Lock "cinder-200cda6f-b993-475c-bacb-4935fe2d58d3-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=81909) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 15:42:08 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:UPDATE=111,cinder:SELECT=73,cinder:DELETE=9,cinder:INSERT=24 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 15:42:08 devstack cinder-volume[81909]: DEBUG dbcounter [-] [81909] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=81909) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}